-- Logs begin at Fri 2022-06-17 06:37:02 UTC, end at Fri 2022-06-17 08:02:02 UTC. -- Jun 17 07:25:30.938560 dv-cinder-797333-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 07:25:30.947485 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 07:25:30 2022] *** Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: nodename: dv-cinder-797333-4-iscsi Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: machine: x86_64 Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: clock source: unix Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: pcre jit disabled Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: detected number of CPU cores: 4 Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: current working directory: / Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: detected binary path: /usr/bin/uwsgi-core Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: your processes number limit is 47680 Jun 17 07:25:30.950954 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: your memory page size is 4096 bytes Jun 17 07:25:30.951819 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: detected max file descriptor number: 2048 Jun 17 07:25:30.951819 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: lock engine: pthread robust mutexes Jun 17 07:25:30.951819 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: thunder lock: enabled Jun 17 07:25:30.951819 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 07:25:30.951819 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 07:25:30.994484 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: Python main interpreter initialized at 0x55b6b21f69c0 Jun 17 07:25:30.994484 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: python threads support enabled Jun 17 07:25:30.994484 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: your server socket listen backlog is limited to 100 connections Jun 17 07:25:30.994484 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: your mercy for graceful operations on workers is 90 seconds Jun 17 07:25:30.994879 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 07:25:30.995071 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: *** Operational MODE: preforking *** Jun 17 07:25:30.995352 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: *** uWSGI is running in multiple interpreter mode *** Jun 17 07:25:30.995352 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: spawned uWSGI master process (pid: 103636) Jun 17 07:25:30.995562 dv-cinder-797333-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 07:25:30.997058 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: spawned uWSGI worker 1 (pid: 103637, cores: 1) Jun 17 07:25:30.997246 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: spawned uWSGI worker 2 (pid: 103638, cores: 1) Jun 17 07:25:30.997426 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 07:25:31.671523 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 07:25:31.675417 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 07:25:32.859170 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:25:32.859170 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: from cryptography.utils import int_from_bytes Jun 17 07:25:32.859792 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:25:32.859792 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: from cryptography.utils import int_from_bytes Jun 17 07:25:32.861760 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:25:32.861760 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: from cryptography.utils import int_from_bytes Jun 17 07:25:32.862176 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:25:32.862176 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: from cryptography.utils import int_from_bytes Jun 17 07:25:35.467710 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:25:35.468290 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:25:35.468475 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:25:35.468825 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:25:35.469077 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:25:35.469308 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:25:35.469695 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.469787 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:25:35.469874 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.470102 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:25:35.470191 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.470416 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.470542 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:25:35.470707 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:25:35.470791 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.471037 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.471122 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.471354 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.471440 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.471671 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.471762 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.471997 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.472082 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.472254 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.472345 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.472568 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.472655 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.472888 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797333-4-iscsi {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.473030 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.473206 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.473367 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.473536 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.473663 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.473825 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.473962 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.474142 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.474267 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.474441 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.474565 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797333-4-iscsi {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.474759 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.474893 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.475061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.475186 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.475368 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.475554 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.475712 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.476709 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.476840 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.476840 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.477055 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.477186 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.477306 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.477455 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.477606 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.477750 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.477863 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.477999 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.478122 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.478250 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.478378 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.478491 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.478618 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.478748 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.478870 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.478992 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.479113 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.479242 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797333-4-iscsi {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.479370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.479667 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.479802 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.479925 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.480047 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.480169 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.480290 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.480613 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797333-4-iscsi {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.480760 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.480892 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.481015 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.481137 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.481277 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.481444 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.481576 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.481841 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.481977 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.482155 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.482290 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.482467 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.482593 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.482788 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.482915 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.483103 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.483241 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.483411 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.483536 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.483706 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.483839 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.484012 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.484139 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.484319 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.484446 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.484633 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.484760 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.484933 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.485072 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.485232 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.485392 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.485516 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.485650 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.485786 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.485910 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.486100 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.486233 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.486418 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.486553 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.486675 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.486785 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.486969 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.487103 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.487227 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.487358 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.487516 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.487649 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.487831 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.487958 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.488134 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.488271 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.488395 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.488508 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.488724 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.488888 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.489025 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.489147 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.489311 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.489469 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.489634 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.489773 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.489936 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.490064 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.490239 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.490373 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.490736 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.490885 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.491017 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.491149 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.491272 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.491393 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.491521 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.491656 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.491779 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.491901 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.492023 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.492145 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.492340 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.492477 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.492644 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.492768 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.492967 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.493092 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.493297 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.493471 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.493605 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.493736 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.493898 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.494024 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.494214 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.494344 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.494520 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.494653 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.494822 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.494947 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.495235 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.495369 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.495493 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.495624 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.495862 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.495997 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.496172 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.496307 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.496431 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.496551 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.496734 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.496861 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.497040 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.497167 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.497388 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.497520 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.497664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.497803 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.497969 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.498095 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.498276 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.498403 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.498571 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.498705 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.498874 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.499000 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.499179 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.499305 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.499485 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.499620 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.499786 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.499911 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.500090 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.500215 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.500390 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.500531 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.500697 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.500824 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.500998 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.501099 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.501299 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.501405 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.501630 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.501731 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.501941 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.502036 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.502243 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.502330 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.502545 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.502645 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.502850 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.502964 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.503150 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.503250 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.503465 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.503558 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.503769 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.503855 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.504069 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.504162 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.504373 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.504466 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.504674 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.504766 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.504973 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.505060 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.505279 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.505393 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.505608 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.505707 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.505912 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.506011 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.506214 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.506299 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.506509 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.506594 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.506815 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.506904 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.507120 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.507207 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.507422 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.507515 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.507723 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.507809 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.508022 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.508105 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.508330 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.508440 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.508631 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.508718 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.508934 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.509027 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.509233 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.509349 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.509557 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.509655 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.509854 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.509942 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.510158 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.510257 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.510466 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.510553 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.511537 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.511659 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.511838 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.511968 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.512139 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.512295 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.512455 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.512619 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.512787 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.512937 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.513103 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.513249 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.513468 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.513617 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.513769 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.513907 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:25:35.514101 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.514248 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.514429 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.514588 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.514740 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.514888 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.515025 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.515159 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.515343 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.515494 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.515654 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.515791 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.515960 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.516113 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.516259 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.516404 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.516553 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.516703 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.516862 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.517012 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.517179 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.517354 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.517530 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.517672 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.517846 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.518077 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.518229 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.518375 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.518511 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.518646 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.518792 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.518928 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.519070 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.519223 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.519382 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.519526 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.519700 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.519843 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.520008 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.520164 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.520344 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.520489 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.520682 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.520832 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.520992 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.521154 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.521309 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.521479 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.521755 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.521900 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.522053 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.522198 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.522334 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.522469 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.522605 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.522750 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.522899 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.523044 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.523181 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.523316 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.523451 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.523587 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.523731 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.523876 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.524039 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.524190 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.524349 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.524492 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.524647 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.524794 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.524951 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.525094 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.525259 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.525447 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.525615 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.525770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.525930 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.526080 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.526230 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.526463 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.527095 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.527242 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.527536 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.527684 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.527823 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.527969 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.528106 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.528242 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.528377 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.528513 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.528649 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.528793 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.528930 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.529077 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.529220 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.529379 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.529522 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.529670 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.529815 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.529952 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.530088 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.530247 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.530399 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.530543 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.530679 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.530851 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.531005 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.531142 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.531286 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.531461 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.531605 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.531877 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.532022 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.532159 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.532304 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.532441 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.532576 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.532711 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.532845 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.532998 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.533150 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.533288 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.533461 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.533599 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.533747 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.533901 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.534046 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.534183 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.534319 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.534496 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.534640 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.534785 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.534947 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.535087 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.535232 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.535368 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.535503 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.535670 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.535814 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.535980 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.536132 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.536291 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.536441 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.536586 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.536728 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.536881 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.537018 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.537189 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.537400 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.537545 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.537680 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.537815 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.537949 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.538121 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.538275 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.538444 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.538588 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.538741 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.538879 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.539059 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.539211 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.539380 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.539521 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.539684 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.539834 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.539990 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.540135 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.540271 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.540407 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.540568 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.540721 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.540865 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.541002 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.541146 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.541289 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.541455 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.541592 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.541746 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.542074 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.542272 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.542411 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.542597 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.542754 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.542910 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.543048 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.543214 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.543356 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.543523 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.543741 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.543881 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.544140 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.544288 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.544424 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.544570 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.544717 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.544717 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.544987 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.545123 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.545258 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.545440 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.545593 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.545731 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.545866 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.546000 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.546134 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.546269 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.546412 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.546548 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.546695 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.546866 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.547011 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.547202 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.547346 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.547512 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.547655 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.547824 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.547967 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.548134 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.548284 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.548450 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.548591 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.548762 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.548905 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.549078 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.549221 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.549408 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.549551 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.549714 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.549866 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.550017 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.550154 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.550325 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.550468 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.550627 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.550791 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.550942 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.551086 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.551259 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.551400 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.551571 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.551729 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.551888 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.552182 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.552182 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.552459 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.552603 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.552748 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.552902 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.553038 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.553173 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.553316 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.553498 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.553645 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.553790 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.553926 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.554062 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.554198 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.554376 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.554529 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.554676 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.554819 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.554983 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.555135 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.555273 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.555416 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.555591 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.555732 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.555896 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.556044 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.556211 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.556362 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.556498 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.556645 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.556792 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.556928 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.557114 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.557266 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.557507 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.557686 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.557835 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.557980 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.558172 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.558317 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.558584 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.558728 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.558915 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.559059 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.559229 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.559373 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.559541 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.559859 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.560013 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.560159 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.560386 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.560530 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.560727 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.560870 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.561035 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.561197 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.561375 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.561521 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.561657 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.561792 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.561959 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.562135 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.562417 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.562554 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.562698 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.562843 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.562979 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.563124 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.563270 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.563406 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.563550 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.563688 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.563832 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.563969 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.564104 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.564246 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.564383 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.564519 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.564669 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.564807 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.564960 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.565097 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.565232 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.565406 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.565559 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.565707 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.565845 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.565987 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.566134 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.566272 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.566416 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.566552 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.566721 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.566887 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.567025 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.567177 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.567314 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.567615 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.567761 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.567919 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.568071 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.568216 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.568353 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.568515 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.568683 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.568833 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.568986 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.569124 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.569259 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.569464 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.569602 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.569750 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.569896 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.570033 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.570168 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.570327 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.570471 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.570637 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.570793 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.570929 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.571071 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.571239 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.571383 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.571557 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.571700 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.571860 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.572003 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.572167 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.572441 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.572656 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.572802 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.572951 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.573087 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.573762 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.573917 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.574064 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.574201 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.574441 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.574650 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.574793 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.574975 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.575119 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.575297 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.575463 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.575600 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.575736 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.575910 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.576055 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.576225 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.576367 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.576548 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.576692 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.576921 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.577111 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.577270 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.577479 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.577651 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.577796 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.577939 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.578090 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.578233 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.578410 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.578557 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.578699 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.578841 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.578992 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.579136 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.579285 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.579435 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.579587 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.579729 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.579889 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.580048 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.580194 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.580336 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.580477 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.580626 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.580776 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.580927 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.581079 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.581230 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.581447 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.581594 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.581754 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.581899 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.582041 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.582228 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.582328 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.582416 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.582502 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.582652 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.582780 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.582960 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.583079 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.583266 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.583366 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.583572 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.583702 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.583893 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.583992 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.584197 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.584307 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.584508 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.584629 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.584812 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.584964 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.585135 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.585265 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.585469 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.585658 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.585776 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.585977 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.586074 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.586284 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.586370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.586584 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.586705 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.586882 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.587012 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.587185 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.587351 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.587490 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.587682 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.587789 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.588025 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.588113 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.588332 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.588426 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.588640 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.588742 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.589590 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.589762 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.589929 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.590077 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.590193 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.590292 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.590494 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.590581 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.590806 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.590892 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.591112 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.591209 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.591412 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.591507 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.591712 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.591809 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.592019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.592116 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.592326 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.592433 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.592623 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.592712 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.592925 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.593011 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.593223 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.593316 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.593551 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.593649 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.593853 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.593961 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.594156 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.594254 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.594454 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.594550 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.594758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.594845 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.595061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.595147 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.595360 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.595447 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.595663 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.595763 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.595969 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.596063 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.596269 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.596365 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.596569 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.596657 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.596873 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.596960 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.597170 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.597379 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.597497 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.597583 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.597798 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.597885 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.598106 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.598200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.598409 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.598497 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.598706 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.598791 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.599010 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.599115 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.599309 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.599397 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.599613 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.599699 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.599913 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.600001 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.600214 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.600299 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.600508 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.600593 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.600806 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.600901 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.601102 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.601190 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.601422 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.601514 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.601721 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.601810 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.602034 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.602119 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.602348 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.602497 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.602634 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.602763 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.602933 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.603019 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.603233 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.603334 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.603531 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.603616 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.603839 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.603924 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.604157 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.604300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.604465 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.604622 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.604771 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.604919 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.605082 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.605250 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.605404 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.605524 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.605708 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.605839 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.606011 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.606152 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.606314 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.606456 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.606653 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.606770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.606957 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.607081 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.607318 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.607412 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.607626 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.607713 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.607941 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.608029 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.608262 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.608350 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.608573 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.608667 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.608884 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.608972 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.609194 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.609286 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.609525 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.609617 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.609840 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.609928 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.610141 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.610226 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.610449 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.610543 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.610750 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.610844 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.611051 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.611138 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.611358 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.611451 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.611666 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.611766 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.611974 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.612059 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.612280 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.612375 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.612591 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.612679 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.612902 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.612989 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.613203 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.613297 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.613533 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.613619 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.613842 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.613928 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.614148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.614247 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.614450 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.614540 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.614756 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.614848 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.615067 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.615154 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.615367 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.615454 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.615674 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.615760 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.615976 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.616064 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.616285 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.616379 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.616586 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.616673 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.616895 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.617010 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.617210 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.617333 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.617544 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.617706 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.617867 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.618012 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.618178 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.618321 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.618482 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.618630 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.618794 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.618947 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.619097 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.619259 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.619406 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.619563 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.619709 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.619977 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.620210 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.620419 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.620525 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.620829 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.620933 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.621131 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.621218 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.621469 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.621560 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.621789 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.621878 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.622109 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.622198 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.622437 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.622537 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.622743 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.622834 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.623047 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.623195 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.623351 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.623510 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.623673 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.623828 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.623977 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.624141 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.624296 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.624447 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.624715 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.624802 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.625029 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.625124 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.625378 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.625485 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.625675 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.625764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.625980 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.626067 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.626285 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.626385 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.626606 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.626700 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.626912 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.627007 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.627234 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.627321 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.627581 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.627665 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.627900 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.627993 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.628212 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.628306 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.628537 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.628644 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.628864 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.628951 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.629176 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.629273 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.629530 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.629621 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.629834 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.629921 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.630155 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.630243 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.630475 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.630564 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.630786 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.630873 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.631093 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.631200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.631416 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.631503 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.631738 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.631825 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.632049 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.632144 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.632362 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.632449 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.632666 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.632754 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.632987 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.633123 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.633305 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.633456 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.633638 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.633726 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.633943 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.634045 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.634246 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.634354 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.634568 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.634677 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.634871 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.634987 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.635180 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.635309 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.635490 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.635635 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.636600 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.636752 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.637008 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.637151 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.637342 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.637480 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.637729 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.637882 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.638028 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.638196 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.638359 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.638512 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.638670 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.638760 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.638850 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.639073 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.639162 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.639394 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.639483 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.639698 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.639785 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.639999 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.640096 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.640320 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.640415 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.640622 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.640714 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.640923 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.641011 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.641226 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.641314 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.641574 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.641661 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.641885 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.641970 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.642188 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.642275 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.642513 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.642601 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.642825 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.642920 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.643131 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.643219 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.643436 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.643553 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.643754 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.643863 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.644081 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.644173 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.644389 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.644479 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.644708 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.644809 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.645010 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.645101 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.645312 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.645422 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.645640 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.645749 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.645942 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.646038 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.646244 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.646335 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.646547 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.646639 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.646859 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.646957 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.647160 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.647275 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.647460 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.647549 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.647759 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.647848 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.648078 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.648172 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.648376 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.648466 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.648686 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.648772 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.648990 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.649076 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.649291 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.649442 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.649615 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.649713 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.649919 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.650016 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.650224 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.650310 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.650544 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.650638 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.650844 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.650938 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.651167 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.651253 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.652026 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.652187 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.652340 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.652515 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.652624 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.652715 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.652911 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.653024 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.653249 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.653384 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.653579 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.653679 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.653915 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.654002 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.654236 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.654325 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.654559 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.654646 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.654874 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.654972 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.655181 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.655269 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.655485 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.655579 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.655802 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.655896 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.656116 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.656202 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.656429 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.656514 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.656743 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.656945 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.657061 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.657271 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.657400 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.657609 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.657708 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.657922 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.658010 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.658234 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.658321 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.658547 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.658643 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.658860 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.658948 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.659170 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.659417 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.659515 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.659743 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.659839 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.660057 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.660144 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.660370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.660458 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.660682 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.660770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.660996 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.661085 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.661311 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.661417 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.661648 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.661737 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.661958 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.662053 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.662268 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.662355 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.662577 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.662666 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.662904 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.662992 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.663225 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.663319 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.663530 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.663624 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.663842 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.663929 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.664156 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.664253 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.664468 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.664555 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.664775 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.664876 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.665088 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.665188 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.665419 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.665525 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.665733 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.665827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.666042 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.666130 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.666346 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.666442 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.666656 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.666743 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.667009 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.667116 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.667330 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.667431 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.667648 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.667752 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.667968 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.668054 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.668275 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.668375 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.668585 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.668684 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.668897 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.668988 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.669210 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.669452 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.669543 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.669768 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.669860 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.670105 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.670197 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.670428 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.670529 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.670750 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.670841 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.671065 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.671164 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.671381 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.671486 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.671705 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.671896 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.672012 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.672210 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.672318 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.672542 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.672639 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.672867 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.672977 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.673187 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.673306 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.673528 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.673625 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.673834 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.673933 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.674136 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.674234 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.674451 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.674538 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.674754 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.674839 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.675081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.675281 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.675372 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.675633 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.675721 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.675951 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.676046 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.676268 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.676355 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.676573 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.676661 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.676891 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.676986 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.677199 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.677297 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.677563 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.677753 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.677875 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.678108 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.678208 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.678426 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.678518 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.678756 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.678848 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.679074 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.679164 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.679378 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.679470 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.679687 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.679785 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.679997 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.680087 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.680298 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.680390 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.680603 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.680701 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.680927 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.681017 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.681235 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.681351 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.682136 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.682224 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.682347 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.682436 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.682524 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.683165 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.683338 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.683496 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.683602 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.683692 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.683773 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.683859 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.683948 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.684028 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.684305 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.684420 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.684608 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.684714 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.684850 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.684945 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.685142 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.685261 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.685481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.685590 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.685788 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.685876 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.686094 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.686181 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.686400 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.686494 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.686704 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.686789 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.687018 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.687105 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.687324 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.687419 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.687635 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.687721 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.687940 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.688025 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.688248 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.688347 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.688554 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.688639 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.688866 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.688951 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.689175 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.689263 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.689542 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.689631 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.689851 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.689938 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.690158 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.690383 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.690471 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.690713 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.690800 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.691031 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.691126 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.691362 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.691450 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.691681 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.691773 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.691985 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.692078 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.692287 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.692382 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.692590 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.692850 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.692945 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.693188 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.693282 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.693523 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.693628 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.693833 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.693939 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.694140 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.694228 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.694448 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.694570 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.694756 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.694872 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.695063 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.695169 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.695370 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.695486 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.695677 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.695775 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.695983 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.696126 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.696287 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.696433 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.696649 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.696793 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.696931 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.697074 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.697209 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.697374 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.697521 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.697670 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.697806 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.697940 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.698108 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.698346 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.698536 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.698729 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.698926 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.699124 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.699334 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.699334 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.699763 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.700005 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.700230 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.700433 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.700573 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.700720 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.700858 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.700993 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.701127 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.701261 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.701423 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.701571 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.701709 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.701845 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.701991 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.702128 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.702271 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.702407 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.702541 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.702676 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.702810 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.702952 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.703097 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.703239 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.703375 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.703605 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.703753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.703889 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.704033 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.704169 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.704306 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.704442 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.704607 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.704751 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.704889 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.705028 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.705162 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.705298 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.705463 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.705591 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.705731 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.705915 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.705993 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.706229 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.706313 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.706528 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.706605 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.706831 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.706909 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.707140 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.707229 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.707455 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.707533 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.707878 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.707978 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.708049 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.708127 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.708348 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.708434 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.708654 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.708731 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.708956 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.709041 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.709257 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.709356 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.709584 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.709661 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.710057 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.710368 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.710668 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.710969 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.711270 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.711457 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.711583 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.711803 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.711891 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.712136 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.712225 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.712437 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.712533 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.712739 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.712826 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.713039 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.713126 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.713355 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.713461 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.713664 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.713763 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.714512 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.714795 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.714943 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.715083 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.715270 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.715359 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.715583 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.715670 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.715899 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.715992 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.716207 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.716303 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.716521 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.716607 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.716825 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.716913 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.717136 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.717222 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.717480 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.717577 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.717837 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.717939 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.718097 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.718184 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.718404 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.718499 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.718725 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.718811 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.719035 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.719126 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.719343 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.719445 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.719652 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.719741 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.719960 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.720047 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.720268 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.720370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.720597 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.720686 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.720918 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.721005 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.721223 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.721354 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.721573 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.721661 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.721888 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.721973 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.722206 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.722294 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.722521 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.722607 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.722834 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.722921 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.723149 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.723236 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.723459 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.723544 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.723772 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.723872 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.724083 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.724170 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.724390 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.724477 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.724702 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.724838 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.725019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.725107 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.725347 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.725440 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.725680 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.725777 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.726005 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.726095 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.726315 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.726402 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.726629 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.726789 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.726954 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.727042 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.727268 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.727362 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.727581 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.727677 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.727901 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.727989 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.728216 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.728303 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.728532 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.728628 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.728842 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.728936 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.729149 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.729236 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.729414 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:25:35.730119 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.730361 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.730678 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.731002 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.731333 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.731681 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.732000 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.732348 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.732678 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.732998 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.733316 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.733666 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:25:35.733914 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:25:35.791694 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO dbcounter [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Registered counter for database nova_api Jun 17 07:25:35.796057 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO dbcounter [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Registered counter for database nova_api Jun 17 07:25:35.814535 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_db.sqlalchemy.engines [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:25:35.815241 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG oslo_db.sqlalchemy.engines [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:25:35.821091 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writer thread running {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:25:35.821691 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writer thread running {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:25:35.885041 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.context [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d9e8a95-f347-4e57-9496-74641ae5645e(cell1) {{(pid=103637) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 07:25:35.886550 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.context [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d9e8a95-f347-4e57-9496-74641ae5645e(cell1) {{(pid=103638) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 07:25:35.889469 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:35.890702 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG oslo_concurrency.lockutils [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:35.891009 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:35.891798 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:35.892262 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG oslo_concurrency.lockutils [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:35.893058 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG oslo_concurrency.lockutils [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:35.893770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:35.895050 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG oslo_concurrency.lockutils [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:35.895758 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO dbcounter [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Registered counter for database nova_cell0 Jun 17 07:25:35.897016 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO dbcounter [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Registered counter for database nova_cell0 Jun 17 07:25:35.899573 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO dbcounter [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Registered counter for database nova_cell1 Jun 17 07:25:35.900949 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO dbcounter [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Registered counter for database nova_cell1 Jun 17 07:25:35.907248 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_db.sqlalchemy.engines [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:25:35.909515 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_db.sqlalchemy.engines [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:25:35.910482 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG oslo_db.sqlalchemy.engines [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:25:35.912129 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG oslo_db.sqlalchemy.engines [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:25:35.913450 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writer thread running {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:25:35.918567 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writer thread running {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:25:35.920606 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writer thread running {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:25:36.053288 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writer thread running {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:25:36.062082 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO dbcounter [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Registered counter for database nova_cell0 Jun 17 07:25:36.064816 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO dbcounter [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Registered counter for database nova_cell0 Jun 17 07:25:36.070899 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_db.sqlalchemy.engines [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:25:36.075678 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG oslo_db.sqlalchemy.engines [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:25:36.076534 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writer thread running {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:25:36.082248 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writer thread running {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:25:36.528520 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: WARNING keystonemiddleware.auth_token [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:25:36.535238 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: WARNING keystonemiddleware.auth_token [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:25:36.535781 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: WARNING keystonemiddleware.auth_token [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:25:36.542418 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: WARNING keystonemiddleware.auth_token [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:25:36.881537 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: WARNING keystonemiddleware.auth_token [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:25:36.883302 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: WARNING keystonemiddleware.auth_token [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:25:36.887717 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: WARNING keystonemiddleware.auth_token [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:25:36.889791 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: WARNING keystonemiddleware.auth_token [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:25:36.892955 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b6b21f69c0 pid: 103638 (default app) Jun 17 07:25:36.895011 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:36.895116 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b6b21f69c0 pid: 103637 (default app) Jun 17 07:25:36.896170 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-3fe30f92-69bf-4aca-bb14-cc9de4162dea None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001692 Jun 17 07:25:36.896569 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Fri Jun 17 07:25:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:56.739655 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:56.740966 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Jun 17 07:26:56.741655 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:26:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:56.753294 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writing DB stats nova_api:SELECT=3 {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:56.754444 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writing DB stats nova_cell0:SELECT=3 {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:56.755270 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writing DB stats nova_cell1:SELECT=3 {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:56.756505 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:57.202948 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-2e45c7d2-56fa-4e9c-996d-8f8f5cf8bdd3 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:57.232614 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-2e45c7d2-56fa-4e9c-996d-8f8f5cf8bdd3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.484574 Jun 17 07:26:57.233281 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1291 bytes} [Fri Jun 17 07:26:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:59.402142 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:59.403126 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-34baaa2c-e235-4cd2-99fa-73fd29b8c34a None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 17 07:26:59.403517 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:59.471270 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-05e65537-6052-4170-82b3-22ade8e08d7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:59.491435 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:26:59.491435 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: warnings.warn(msg) Jun 17 07:26:59.580881 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-05e65537-6052-4170-82b3-22ade8e08d7d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.171345 Jun 17 07:26:59.581966 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:26:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:26:59.596355 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_api:SELECT=3 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:59.597099 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_cell0:SELECT=3 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:59.598006 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_cell1:SELECT=3 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:59.599059 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:59.807032 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-2370c188-9d9b-4762-9531-11b4eea92cd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:59.809457 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:26:59.809457 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: warnings.warn(msg) Jun 17 07:26:59.943856 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-2370c188-9d9b-4762-9531-11b4eea92cd3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353128 Jun 17 07:26:59.944767 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1335 bytes} [Fri Jun 17 07:26:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:27:02.145173 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-05e65537-6052-4170-82b3-22ade8e08d7d admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:02.146212 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-05e65537-6052-4170-82b3-22ade8e08d7d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 17 07:27:02.146608 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:02.254535 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-52bc3de8-9823-473b-ab1a-7a40c57f9888 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:02.273036 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:27:02.273036 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: warnings.warn(msg) Jun 17 07:27:02.387167 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-52bc3de8-9823-473b-ab1a-7a40c57f9888 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.232449 Jun 17 07:27:02.387991 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:02.404478 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-57765621-8c35-477f-8c98-ad47d5bdd832 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:02.407075 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:27:02.407075 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: warnings.warn(msg) Jun 17 07:27:02.527852 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-57765621-8c35-477f-8c98-ad47d5bdd832 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130882 Jun 17 07:27:02.528449 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1335 bytes} [Fri Jun 17 07:27:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:27:05.375934 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-52bc3de8-9823-473b-ab1a-7a40c57f9888 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:05.376923 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-52bc3de8-9823-473b-ab1a-7a40c57f9888 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 17 07:27:05.377558 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:05.441102 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-7445529d-b031-464f-81c6-10acc1ef5e86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:05.533896 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-7445529d-b031-464f-81c6-10acc1ef5e86 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150614 Jun 17 07:27:05.541947 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:27:05.548711 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-6a8158fe-0ca8-4ebb-9636-0955ecf5d097 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:05.637813 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-6a8158fe-0ca8-4ebb-9636-0955ecf5d097 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093954 Jun 17 07:27:05.638387 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1335 bytes} [Fri Jun 17 07:27:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:07.819149 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-7445529d-b031-464f-81c6-10acc1ef5e86 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:07.820170 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-7445529d-b031-464f-81c6-10acc1ef5e86 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 17 07:27:07.820944 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:07.881202 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-530ad57f-4f23-47c5-9fe0-a5c428f6e004 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "swap": 0, "ram": 2048, "name": "ds2G", "disk": 10}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:07.973294 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-530ad57f-4f23-47c5-9fe0-a5c428f6e004 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146130 Jun 17 07:27:07.973910 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:07.985845 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-4806f4d8-0fc2-4363-ac10-93dfd716e7f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:08.091672 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-4806f4d8-0fc2-4363-ac10-93dfd716e7f3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105591 Jun 17 07:27:08.091672 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1335 bytes} [Fri Jun 17 07:27:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:10.286958 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-530ad57f-4f23-47c5-9fe0-a5c428f6e004 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:10.287919 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-530ad57f-4f23-47c5-9fe0-a5c428f6e004 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 17 07:27:10.288312 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:27:10.349907 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-6214a1d3-1988-42a1-8271-2a0e33d3e5a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:10.470648 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-6214a1d3-1988-42a1-8271-2a0e33d3e5a0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.175810 Jun 17 07:27:10.478904 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:10.484451 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-2aa493bd-dcf4-4218-8c34-80d7aabbe704 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:10.567180 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-2aa493bd-dcf4-4218-8c34-80d7aabbe704 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086577 Jun 17 07:27:10.567799 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1335 bytes} [Fri Jun 17 07:27:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:12.783673 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-6214a1d3-1988-42a1-8271-2a0e33d3e5a0 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:12.784678 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-6214a1d3-1988-42a1-8271-2a0e33d3e5a0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 17 07:27:12.788448 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:12.846184 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-fa1b1ca8-5946-461c-9d99-f1b85031217f admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:12.870950 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-fa1b1ca8-5946-461c-9d99-f1b85031217f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079544 Jun 17 07:27:12.871596 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1291 bytes} [Fri Jun 17 07:27:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:27:15.278561 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-6214a1d3-1988-42a1-8271-2a0e33d3e5a0 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:15.279528 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-6214a1d3-1988-42a1-8271-2a0e33d3e5a0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 17 07:27:15.279933 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:15.344006 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-d8984434-c7b5-4407-bbde-89d0bfe82a76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "ram": 512, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:15.481264 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-d8984434-c7b5-4407-bbde-89d0bfe82a76 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.195479 Jun 17 07:27:15.481857 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:27:15.494638 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-dfc4695b-2a0f-4cbf-be34-d46a34363b44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:15.654152 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-dfc4695b-2a0f-4cbf-be34-d46a34363b44 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146577 Jun 17 07:27:15.654152 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1332 bytes} [Fri Jun 17 07:27:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:18.123810 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-d8984434-c7b5-4407-bbde-89d0bfe82a76 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:18.125071 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-d8984434-c7b5-4407-bbde-89d0bfe82a76 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001891 Jun 17 07:27:18.125635 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:18.192362 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-7881a18d-98c5-4d8b-928b-ee0f1443022b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small"}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:18.284504 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-7881a18d-98c5-4d8b-928b-ee0f1443022b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.152941 Jun 17 07:27:18.285072 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:18.297760 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-1579b514-9cd1-4811-a6fd-89b1926f8664 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:18.373231 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-1579b514-9cd1-4811-a6fd-89b1926f8664 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079027 Jun 17 07:27:18.373849 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1332 bytes} [Fri Jun 17 07:27:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:20.581654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-7881a18d-98c5-4d8b-928b-ee0f1443022b admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:20.582703 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-7881a18d-98c5-4d8b-928b-ee0f1443022b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 17 07:27:20.583110 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:20.641042 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-b2324603-3306-4ef1-a084-f2a73d4f2005 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:20.717557 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-b2324603-3306-4ef1-a084-f2a73d4f2005 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128170 Jun 17 07:27:20.718134 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:27:20.731515 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-75df49d0-eb54-4287-bb70-507ad80a8f96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:21.127212 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-75df49d0-eb54-4287-bb70-507ad80a8f96 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.400080 Jun 17 07:27:21.127835 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1332 bytes} [Fri Jun 17 07:27:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:23.356528 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-b2324603-3306-4ef1-a084-f2a73d4f2005 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:23.357494 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-b2324603-3306-4ef1-a084-f2a73d4f2005 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 17 07:27:23.357880 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:23.418024 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-1377129f-ee73-4c7e-b7b4-a4dca438011f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "id": "4", "vcpus": 4, "name": "m1.large"}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:23.495231 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-1377129f-ee73-4c7e-b7b4-a4dca438011f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.131404 Jun 17 07:27:23.496131 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:23.508069 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-ffabfba2-2609-4b19-a943-6c5bc5958e94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:23.590973 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-ffabfba2-2609-4b19-a943-6c5bc5958e94 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086616 Jun 17 07:27:23.591769 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1332 bytes} [Fri Jun 17 07:27:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:27:25.787487 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-1377129f-ee73-4c7e-b7b4-a4dca438011f admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:25.789133 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-1377129f-ee73-4c7e-b7b4-a4dca438011f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Jun 17 07:27:25.789891 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:25.853551 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-821d6125-af7c-4b5f-87fb-2d29e1c0e942 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "swap": 0}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:26.081876 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-821d6125-af7c-4b5f-87fb-2d29e1c0e942 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.275773 Jun 17 07:27:26.081876 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1282 bytes} [Fri Jun 17 07:27:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:27:26.086252 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-e965c61e-52f3-4749-9da7-ce48f382f24e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:26.858978 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:26.863284 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-e965c61e-52f3-4749-9da7-ce48f382f24e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.780972 Jun 17 07:27:26.865264 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1332 bytes} [Fri Jun 17 07:27:26 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:27:49.728796 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-821d6125-af7c-4b5f-87fb-2d29e1c0e942 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:49.729818 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-821d6125-af7c-4b5f-87fb-2d29e1c0e942 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 17 07:27:49.730211 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:27:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:49.789248 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-def1d0f2-e615-4ed0-92fc-d293d9df118d admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:49.807167 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-def1d0f2-e615-4ed0-92fc-d293d9df118d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070741 Jun 17 07:27:49.807706 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1291 bytes} [Fri Jun 17 07:27:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:27:50.781446 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-821d6125-af7c-4b5f-87fb-2d29e1c0e942 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:50.782484 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-821d6125-af7c-4b5f-87fb-2d29e1c0e942 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 17 07:27:50.782881 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:27:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:50.972314 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-46a842be-d3a6-4512-9f5e-6fbd8ff6dd05 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:50.978215 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.wsgi [None req-46a842be-d3a6-4512-9f5e-6fbd8ff6dd05 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-46a842be-d3a6-4512-9f5e-6fbd8ff6dd05 admin admin] Request method failure captured: Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Accept: application/json Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Accept-Encoding: gzip, deflate Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Connection: keep-alive Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Content-Length: 0 Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Host: 10.222.0.52 Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Openstack-Api-Version: compute 2.90 Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Openstack-System-Scope: None Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: User-Agent: python-novaclient Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Auth-Token: gAAAAABirCz2o3mNhlZPnsTmt8iHvqxe3dNYPuA5_mlI0FoaR-cZZYclUVOxtXRunyeeB0kC8WexkCFiZsPhNvRkWXbCZr5CNgq1YEW38EnThOz9zSBvX2_s00iHgC6zbmU3eLWW4HmB6VVZY7FGdzxrn39P0E79ae-bw7D8OKBKKGvEkgBOmyk Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Domain-Id: None Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Domain-Name: None Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Identity-Status: Confirmed Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Is-Admin-Project: True Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Domain-Id: default Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Domain-Name: Default Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Name: admin Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Role: admin,reader,member Jun 17 07:27:50.981481 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Roles: admin,reader,member Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant: admin Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant-Name: admin Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User: admin Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Domain-Id: default Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Domain-Name: Default Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Id: 5c26ce8b01664633a37c5e3b13519935 Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Name: admin Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: method: > Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: exception: Flavor 42 could not be found. Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: action_args: {'id': '42'} Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:50.983081 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:50.985148 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-46a842be-d3a6-4512-9f5e-6fbd8ff6dd05 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:50.986262 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-46a842be-d3a6-4512-9f5e-6fbd8ff6dd05 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062666 Jun 17 07:27:50.986262 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Fri Jun 17 07:27:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:50.992317 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-6d144ed7-8664-4816-a54b-4883dec0e5dc admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:50.995603 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:51.015181 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-6d144ed7-8664-4816-a54b-4883dec0e5dc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026342 Jun 17 07:27:51.015712 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Jun 17 07:27:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:27:51.026244 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-d146cee5-95ed-43c6-a149-15b5b1dfd03d admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:51.047877 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-d146cee5-95ed-43c6-a149-15b5b1dfd03d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026106 Jun 17 07:27:51.048446 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Jun 17 07:27:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:27:51.058833 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-129f8e35-3650-4543-94c1-c97caf0e02dd admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:51.064873 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.wsgi [None req-129f8e35-3650-4543-94c1-c97caf0e02dd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-129f8e35-3650-4543-94c1-c97caf0e02dd admin admin] Request method failure captured: Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Accept: application/json Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Accept-Encoding: gzip, deflate Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Connection: keep-alive Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Content-Length: 0 Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Host: 10.222.0.52 Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Openstack-Api-Version: compute 2.90 Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Openstack-System-Scope: None Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: User-Agent: python-novaclient Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Auth-Token: gAAAAABirCz2o3mNhlZPnsTmt8iHvqxe3dNYPuA5_mlI0FoaR-cZZYclUVOxtXRunyeeB0kC8WexkCFiZsPhNvRkWXbCZr5CNgq1YEW38EnThOz9zSBvX2_s00iHgC6zbmU3eLWW4HmB6VVZY7FGdzxrn39P0E79ae-bw7D8OKBKKGvEkgBOmyk Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Domain-Id: None Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Domain-Name: None Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Identity-Status: Confirmed Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Is-Admin-Project: True Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Domain-Id: default Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Domain-Name: Default Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Name: admin Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Role: admin,reader,member Jun 17 07:27:51.068241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Roles: admin,reader,member Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant: admin Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant-Name: admin Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User: admin Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Domain-Id: default Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Domain-Name: Default Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Id: 5c26ce8b01664633a37c5e3b13519935 Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Name: admin Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: method: > Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: exception: Flavor 42 could not be found. Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: action_args: {'id': '42'} Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:51.071770 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:51.072764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:51.074080 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-129f8e35-3650-4543-94c1-c97caf0e02dd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:51.075290 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-129f8e35-3650-4543-94c1-c97caf0e02dd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015363 Jun 17 07:27:51.075290 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Fri Jun 17 07:27:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:51.929143 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-d146cee5-95ed-43c6-a149-15b5b1dfd03d admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:51.930688 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-d146cee5-95ed-43c6-a149-15b5b1dfd03d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 17 07:27:51.931071 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:27:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:52.125676 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-acc7b646-61a0-41b9-b129-c032a48e500b admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:52.130891 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.wsgi [None req-acc7b646-61a0-41b9-b129-c032a48e500b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-acc7b646-61a0-41b9-b129-c032a48e500b admin admin] Request method failure captured: Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Accept: application/json Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Accept-Encoding: gzip, deflate Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Connection: keep-alive Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Content-Length: 0 Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Host: 10.222.0.52 Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Openstack-Api-Version: compute 2.90 Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Openstack-System-Scope: None Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: User-Agent: python-novaclient Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Auth-Token: gAAAAABirCz3z87Mi_m7_Kkw-xboYVl13gOr7JIp0ySHOJQYPUpgAEeCUitTP0ey_787T-wctTbZhSlSge2Nd8M-x0SdgCH-J_0hby1A0ScJ-a4KAO_SrkGt_73vGsOq7HQQX5DiP7b0GmjRAkT0ajl6VUcpgAifpo_RUu3VqQoHin0q8aZcOP8 Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Domain-Id: None Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Domain-Name: None Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Identity-Status: Confirmed Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Is-Admin-Project: True Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Domain-Id: default Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Domain-Name: Default Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Name: admin Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Role: admin,reader,member Jun 17 07:27:52.132371 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Roles: admin,reader,member Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant: admin Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant-Name: admin Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User: admin Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Domain-Id: default Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Domain-Name: Default Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Id: 5c26ce8b01664633a37c5e3b13519935 Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Name: admin Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: method: > Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: exception: Flavor 84 could not be found. Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: action_args: {'id': '84'} Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:52.134300 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:52.135689 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.137019 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-acc7b646-61a0-41b9-b129-c032a48e500b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:52.138400 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-acc7b646-61a0-41b9-b129-c032a48e500b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061367 Jun 17 07:27:52.138400 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Fri Jun 17 07:27:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:52.143881 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-c154e1f2-90e7-4581-96c5-ab34d0a52548 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:52.159988 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-c154e1f2-90e7-4581-96c5-ab34d0a52548 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019798 Jun 17 07:27:52.160522 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Jun 17 07:27:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:27:52.171105 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-42cdb4d8-09f0-4516-98df-103c4829b150 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:52.184578 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-42cdb4d8-09f0-4516-98df-103c4829b150 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017332 Jun 17 07:27:52.185109 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Jun 17 07:27:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:27:52.194179 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-32176357-0316-4a6e-bf4c-196529787ccd admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:52.200229 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.wsgi [None req-32176357-0316-4a6e-bf4c-196529787ccd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-32176357-0316-4a6e-bf4c-196529787ccd admin admin] Request method failure captured: Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Accept: application/json Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Accept-Encoding: gzip, deflate Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Connection: keep-alive Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Content-Length: 0 Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Host: 10.222.0.52 Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Openstack-Api-Version: compute 2.90 Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Openstack-System-Scope: None Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: User-Agent: python-novaclient Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Auth-Token: gAAAAABirCz3z87Mi_m7_Kkw-xboYVl13gOr7JIp0ySHOJQYPUpgAEeCUitTP0ey_787T-wctTbZhSlSge2Nd8M-x0SdgCH-J_0hby1A0ScJ-a4KAO_SrkGt_73vGsOq7HQQX5DiP7b0GmjRAkT0ajl6VUcpgAifpo_RUu3VqQoHin0q8aZcOP8 Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Domain-Id: None Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Domain-Name: None Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Identity-Status: Confirmed Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Is-Admin-Project: True Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Domain-Id: default Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Domain-Name: Default Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Name: admin Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Role: admin,reader,member Jun 17 07:27:52.201758 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Roles: admin,reader,member Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant: admin Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant-Name: admin Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User: admin Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Domain-Id: default Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Domain-Name: Default Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Id: 5c26ce8b01664633a37c5e3b13519935 Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Name: admin Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: method: > Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: exception: Flavor 84 could not be found. Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: action_args: {'id': '84'} Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:52.203287 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:52.204370 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:52.205827 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-32176357-0316-4a6e-bf4c-196529787ccd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:52.207042 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-32176357-0316-4a6e-bf4c-196529787ccd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012471 Jun 17 07:27:52.207042 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Fri Jun 17 07:27:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:53.074587 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-42cdb4d8-09f0-4516-98df-103c4829b150 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:53.075599 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-42cdb4d8-09f0-4516-98df-103c4829b150 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 17 07:27:53.075985 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:27:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:53.265171 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-1ae8c9dd-382c-47ac-bd55-8d1e82a4b425 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:53.270911 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.wsgi [None req-1ae8c9dd-382c-47ac-bd55-8d1e82a4b425 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-1ae8c9dd-382c-47ac-bd55-8d1e82a4b425 admin admin] Request method failure captured: Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Accept: application/json Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Accept-Encoding: gzip, deflate Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Connection: keep-alive Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Content-Length: 0 Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Host: 10.222.0.52 Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Openstack-Api-Version: compute 2.90 Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Openstack-System-Scope: None Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: User-Agent: python-novaclient Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Auth-Token: gAAAAABirCz5duKl03cn0I9sp9cwsFwLNdEt1GTZ8-KPSICToCPbbKAsbEr-YJBRzfZts6XX7hvvwUHWP3gVMSaP0twmwH2NJ5d3JOHTLNFUZhBO9rbyQWBBJXOxZcBqst_vRlOGMErxbU3n2wGSgrJ9YyjnNyAv1mAF6KR9sqddX7Deq0jRJ08 Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Domain-Id: None Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Domain-Name: None Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Identity-Status: Confirmed Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Is-Admin-Project: True Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Domain-Id: default Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Domain-Name: Default Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Project-Name: admin Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Role: admin,reader,member Jun 17 07:27:53.272439 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Roles: admin,reader,member Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant: admin Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-Tenant-Name: admin Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User: admin Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Domain-Id: default Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Domain-Name: Default Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Id: 5c26ce8b01664633a37c5e3b13519935 Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: X-User-Name: admin Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: method: > Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: exception: Flavor 451 could not be found. Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: action_args: {'id': '451'} Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:53.274664 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:53.275654 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.276770 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-1ae8c9dd-382c-47ac-bd55-8d1e82a4b425 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:53.278010 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-1ae8c9dd-382c-47ac-bd55-8d1e82a4b425 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059657 Jun 17 07:27:53.278010 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Jun 17 07:27:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:27:53.284159 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-1f88025e-8e4f-477c-8500-963b82e13591 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:53.298306 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-1f88025e-8e4f-477c-8500-963b82e13591 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017752 Jun 17 07:27:53.298833 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Jun 17 07:27:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:27:53.309355 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:53.323099 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018445 Jun 17 07:27:53.323647 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Fri Jun 17 07:27:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:27:53.332543 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-c34e33b2-031f-4697-b989-802086f00356 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:53.338721 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.wsgi [None req-c34e33b2-031f-4697-b989-802086f00356 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-c34e33b2-031f-4697-b989-802086f00356 admin admin] Request method failure captured: Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Accept: application/json Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Accept-Encoding: gzip, deflate Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Connection: keep-alive Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Content-Length: 0 Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Host: 10.222.0.52 Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Openstack-Api-Version: compute 2.90 Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Openstack-System-Scope: None Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: User-Agent: python-novaclient Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Auth-Token: gAAAAABirCz5duKl03cn0I9sp9cwsFwLNdEt1GTZ8-KPSICToCPbbKAsbEr-YJBRzfZts6XX7hvvwUHWP3gVMSaP0twmwH2NJ5d3JOHTLNFUZhBO9rbyQWBBJXOxZcBqst_vRlOGMErxbU3n2wGSgrJ9YyjnNyAv1mAF6KR9sqddX7Deq0jRJ08 Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Domain-Id: None Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Domain-Name: None Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Identity-Status: Confirmed Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Is-Admin-Project: True Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Domain-Id: default Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Domain-Name: Default Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Project-Name: admin Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Role: admin,reader,member Jun 17 07:27:53.340200 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Roles: admin,reader,member Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be5f0ec6059e4393ac953e1a8c865e6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant: admin Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant-Id: be5f0ec6059e4393ac953e1a8c865e6d Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-Tenant-Name: admin Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User: admin Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Domain-Id: default Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Domain-Name: Default Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Id: 5c26ce8b01664633a37c5e3b13519935 Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: X-User-Name: admin Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: method: > Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: exception: Flavor 451 could not be found. Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: action_args: {'id': '451'} Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:53.341764 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:53.342753 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: ERROR nova.api.openstack.wsgi Jun 17 07:27:53.344061 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-c34e33b2-031f-4697-b989-802086f00356 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:53.345279 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-c34e33b2-031f-4697-b989-802086f00356 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012525 Jun 17 07:27:53.345279 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Jun 17 07:27:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 17 07:27:54.206528 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:54.207529 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 17 07:27:54.207920 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:54.398238 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-e79f6d01-26ab-48af-b43e-9ae49f251de7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:54.479824 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-e79f6d01-26ab-48af-b43e-9ae49f251de7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.133657 Jun 17 07:27:54.480286 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Fri Jun 17 07:27:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:55.379436 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:55.380433 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jun 17 07:27:55.380823 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:55.576610 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-1866be72-ebc9-4d53-84a1-7d7084b081f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:55.910001 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-1866be72-ebc9-4d53-84a1-7d7084b081f6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.387598 Jun 17 07:27:55.910542 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Fri Jun 17 07:27:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:56.832815 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:56.833927 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jun 17 07:27:56.834332 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:57.029435 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-af656211-f376-4f2d-bc3e-0a5109532db4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:57.110961 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-af656211-f376-4f2d-bc3e-0a5109532db4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.135384 Jun 17 07:27:57.111512 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Fri Jun 17 07:27:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:57.970504 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:57.971500 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 17 07:27:57.971889 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:58.163615 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-d9b27575-5591-48e5-8819-d9d88cd005cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:58.267632 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-d9b27575-5591-48e5-8819-d9d88cd005cd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.155353 Jun 17 07:27:58.268103 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Fri Jun 17 07:27:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:27:59.138822 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:59.139865 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 17 07:27:59.140246 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:27:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:59.332916 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-9d7fcd96-41b8-467f-a3f2-e54b69afd7ba admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:59.352034 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-9d7fcd96-41b8-467f-a3f2-e54b69afd7ba admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071177 Jun 17 07:27:59.352500 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Fri Jun 17 07:27:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:28:47.540431 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.541468 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-26c95623-72b1-479e-a2bb-3099fbaf239f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 17 07:28:47.541864 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 930 bytes} [Fri Jun 17 07:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:47.552354 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:47.601953 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-2d7090c1-5beb-4749-b7e0-e7cf1f396447 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.621118 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-2d7090c1-5beb-4749-b7e0-e7cf1f396447 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073235 Jun 17 07:28:47.621674 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1291 bytes} [Fri Jun 17 07:28:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:28:47.644280 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-f2b8bc85-629f-4700-985f-5ca2011692a5 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.648245 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG dbcounter [-] [103638] Writing DB stats nova_api:SELECT=15 {{(pid=103638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:47.653114 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-f2b8bc85-629f-4700-985f-5ca2011692a5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012395 Jun 17 07:28:47.653662 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1282 bytes} [Fri Jun 17 07:28:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:47.666218 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-140c7322-6d28-4d09-9d02-ca712390d79a admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.674193 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-140c7322-6d28-4d09-9d02-ca712390d79a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012916 Jun 17 07:28:47.674724 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1285 bytes} [Fri Jun 17 07:28:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:47.686694 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.695279 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011651 Jun 17 07:28:47.695874 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1285 bytes} [Fri Jun 17 07:28:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:47.707488 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-e8dd5db3-1a05-4e53-853a-b110694d1b9a admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.716042 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-e8dd5db3-1a05-4e53-853a-b110694d1b9a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012144 Jun 17 07:28:47.716553 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1282 bytes} [Fri Jun 17 07:28:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:32:17.583501 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:17.585549 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Jun 17 07:32:17.586161 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:32:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:32:17.746634 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_api:SELECT=6 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:17.862237 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-256b1ba2-b9e1-4731-944b-e0549cdb1cb4 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:17.863479 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:32:17.863479 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: warnings.warn(msg) Jun 17 07:32:17.864663 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-256b1ba2-b9e1-4731-944b-e0549cdb1cb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:17.865092 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-256b1ba2-b9e1-4731-944b-e0549cdb1cb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:17.865885 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-256b1ba2-b9e1-4731-944b-e0549cdb1cb4 admin admin] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:17.866303 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-256b1ba2-b9e1-4731-944b-e0549cdb1cb4 admin admin] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:17.899992 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-256b1ba2-b9e1-4731-944b-e0549cdb1cb4 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154772 Jun 17 07:32:17.900553 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 35/70] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Jun 17 07:32:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:32:18.805662 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:18.806669 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 17 07:32:18.807062 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:32:19.023626 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-1451bba8-8024-46ca-86bb-7325e7324839 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:19.024791 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:32:19.024791 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: warnings.warn(msg) Jun 17 07:32:19.026221 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-1451bba8-8024-46ca-86bb-7325e7324839 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:19.027381 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-1451bba8-8024-46ca-86bb-7325e7324839 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:19.028434 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-1451bba8-8024-46ca-86bb-7325e7324839 admin admin] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:19.028951 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-1451bba8-8024-46ca-86bb-7325e7324839 admin admin] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:19.052567 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-1451bba8-8024-46ca-86bb-7325e7324839 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091802 Jun 17 07:32:19.053201 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Jun 17 07:32:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:32:30.363035 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:30.364071 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 17 07:32:30.364505 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:32:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:32:30.514279 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_cell0:SELECT=4 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:30.515208 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_cell1:SELECT=4 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:30.515634 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG dbcounter [-] [103637] Writing DB stats nova_api:SELECT=8 {{(pid=103637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:30.562926 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-13fc4f17-b507-41d0-a51e-c62567a12777 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:30.564078 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:32:30.564078 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: warnings.warn(msg) Jun 17 07:32:30.565241 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-13fc4f17-b507-41d0-a51e-c62567a12777 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:30.565708 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-13fc4f17-b507-41d0-a51e-c62567a12777 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:30.569276 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-13fc4f17-b507-41d0-a51e-c62567a12777 admin admin] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:30.569276 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-13fc4f17-b507-41d0-a51e-c62567a12777 admin admin] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:30.592372 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-13fc4f17-b507-41d0-a51e-c62567a12777 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083128 Jun 17 07:32:30.592925 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 37/74] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Jun 17 07:32:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:32:31.499612 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: DEBUG nova.api.openstack.wsgi [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] Calling method '>' {{(pid=103638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:31.500618 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: INFO nova.api.openstack.requestlog [None req-e3f08a3e-b6ec-404c-80ef-846b27fdd7c3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 17 07:32:31.501003 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: [pid: 103638|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1074 bytes} [Fri Jun 17 07:32:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:32:31.695851 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG nova.api.openstack.wsgi [None req-2d26e50c-6a01-47e1-b1b1-cf3b0408f622 admin admin] Calling method '>' {{(pid=103637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:31.697026 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:32:31.697026 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: warnings.warn(msg) Jun 17 07:32:31.699055 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-2d26e50c-6a01-47e1-b1b1-cf3b0408f622 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:31.699506 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-2d26e50c-6a01-47e1-b1b1-cf3b0408f622 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:31.700302 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-2d26e50c-6a01-47e1-b1b1-cf3b0408f622 admin admin] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:31.700727 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: DEBUG oslo_concurrency.lockutils [None req-2d26e50c-6a01-47e1-b1b1-cf3b0408f622 admin admin] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:31.722761 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: INFO nova.api.openstack.requestlog [None req-2d26e50c-6a01-47e1-b1b1-cf3b0408f622 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082173 Jun 17 07:32:31.723321 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: [pid: 103637|app: 0|req: 38/76] 10.222.0.52 () {60 vars in 1193 bytes} [Fri Jun 17 07:32:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:33:33.274034 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: Fri Jun 17 07:33:33 2022 - graceful shutdown triggered... Jun 17 07:33:33.274545 dv-cinder-797333-4-iscsi devstack@n-api.service[103637]: Gracefully killing worker 1 (pid: 103637)... Jun 17 07:33:33.274158 dv-cinder-797333-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 17 07:33:33.275339 dv-cinder-797333-4-iscsi devstack@n-api.service[103638]: Gracefully killing worker 2 (pid: 103638)... Jun 17 07:33:34.275180 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: worker 1 buried after 1 seconds Jun 17 07:33:34.275723 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: worker 2 buried after 1 seconds Jun 17 07:33:34.275723 dv-cinder-797333-4-iscsi devstack@n-api.service[103636]: goodbye to uWSGI. Jun 17 07:33:34.276778 dv-cinder-797333-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 17 07:33:34.277382 dv-cinder-797333-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 17 07:33:34.280154 dv-cinder-797333-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 07:33:34.289663 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 07:33:34 2022] *** Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: nodename: dv-cinder-797333-4-iscsi Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: machine: x86_64 Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: clock source: unix Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: pcre jit disabled Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: detected number of CPU cores: 4 Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: current working directory: / Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: detected binary path: /usr/bin/uwsgi-core Jun 17 07:33:34.291668 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: your processes number limit is 47680 Jun 17 07:33:34.293104 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: your memory page size is 4096 bytes Jun 17 07:33:34.293104 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: detected max file descriptor number: 2048 Jun 17 07:33:34.293104 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: lock engine: pthread robust mutexes Jun 17 07:33:34.293104 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: thunder lock: enabled Jun 17 07:33:34.293104 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 07:33:34.293104 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 07:33:34.337165 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: Python main interpreter initialized at 0x562a0696e9c0 Jun 17 07:33:34.337165 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: python threads support enabled Jun 17 07:33:34.337165 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: your server socket listen backlog is limited to 100 connections Jun 17 07:33:34.337165 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: your mercy for graceful operations on workers is 90 seconds Jun 17 07:33:34.337658 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 07:33:34.337658 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: *** Operational MODE: preforking *** Jun 17 07:33:34.337913 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: *** uWSGI is running in multiple interpreter mode *** Jun 17 07:33:34.337913 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: spawned uWSGI master process (pid: 124453) Jun 17 07:33:34.338139 dv-cinder-797333-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 07:33:34.341470 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: spawned uWSGI worker 1 (pid: 124471, cores: 1) Jun 17 07:33:34.341470 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: spawned uWSGI worker 2 (pid: 124472, cores: 1) Jun 17 07:33:34.341470 dv-cinder-797333-4-iscsi devstack@n-api.service[124453]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 07:33:35.010079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 07:33:35.016073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 07:33:36.259168 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:33:36.259168 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: from cryptography.utils import int_from_bytes Jun 17 07:33:36.260274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:33:36.260274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: from cryptography.utils import int_from_bytes Jun 17 07:33:36.295776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:33:36.295776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: from cryptography.utils import int_from_bytes Jun 17 07:33:36.296340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:33:36.296340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: from cryptography.utils import int_from_bytes Jun 17 07:33:38.671704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:33:38.672091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:33:38.672820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:33:38.672944 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:33:38.673121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:33:38.673535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.673869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.674198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.674518 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.674850 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.675168 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.675494 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.675817 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.676142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.676404 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.676718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.677040 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797333-4-iscsi {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.677385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.677700 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.681933 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.682250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.682465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.683492 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.683725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.684200 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.684862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797333-4-iscsi {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.685385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.685853 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.686322 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.686916 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.687394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.687876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.689033 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.689802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.690288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.690672 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.691044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.691390 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.691736 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.692061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.692393 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.692721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.693056 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.693407 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.693729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.693991 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.694311 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.694644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.694975 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.695381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.695696 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.695957 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.696288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.696616 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.696934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.697250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.697618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.698059 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.698387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.699304 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.699622 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.699938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.700266 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.700590 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.700924 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.701242 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.701595 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.702007 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.702266 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.702582 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.702933 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.703262 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.703581 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.703907 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.704238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.704557 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.704868 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.705182 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.705552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.705895 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.706208 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.706468 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.706777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.707090 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.707413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.707727 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.708166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.708485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.708796 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.709110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.709450 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.709770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.710083 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.710397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.710709 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.711022 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.711336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.711648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.711971 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.712296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.712610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.712924 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.713444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.713801 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.714247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.714677 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.715046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.715382 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.715757 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.716078 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.716405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.716721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.717038 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.717385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.717693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.718127 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.718462 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.718780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.719093 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.719404 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.719721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.720034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.720347 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.720659 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.720965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.721475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.721851 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.722185 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.722503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.722934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.723246 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.723570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.723965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.724304 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.724705 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.725053 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.725427 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.725767 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.726138 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.726460 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.726784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.727117 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.727441 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.727758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.728145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.728428 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.728755 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.729091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.729470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.729801 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.730123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.730443 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.730815 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.731101 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.731433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.731753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.732100 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.732449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.732769 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.733098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.733452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.733773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.734091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.734408 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.734737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.735076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.735394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.735719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.736042 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.736357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.736675 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.736994 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.737313 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.737677 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.737998 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.738323 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.738641 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.738963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.739282 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.739606 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.739924 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.740237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.740550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.740869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.741180 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.741517 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.741844 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.742177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.742489 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.742828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.743143 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.743461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.743779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.744097 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.744409 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.744729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.745047 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.745886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.746220 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.746535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.746847 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.747177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.747490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.747842 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.748166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.748535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.748857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.749178 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.749523 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.749851 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.750170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.750489 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.750828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.751167 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.751791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.752121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.752477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.752989 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.753305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.753647 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.754162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.754477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.754791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.755112 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.755422 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.755735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.756045 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.756355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.756667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.756994 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.757309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.757645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.757952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.758262 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.758618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.758932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.759343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.759695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.760025 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.760353 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.760670 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.761601 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.761861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.762214 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.762731 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.763055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.763386 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.763708 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.764037 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.764357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.764687 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.765005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.765346 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.765673 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.765998 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.766345 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.766708 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.767013 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.767341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.767657 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.767978 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.768296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.768619 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.768932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:33:38.769388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.769499 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:33:38.769591 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.769591 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.769762 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:33:38.769921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.770099 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:33:38.770223 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.770355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:33:38.770542 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.770746 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.770871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.771075 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.771188 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.771400 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.771494 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.771723 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.771886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.772047 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.772185 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.772360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.772496 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.772712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.772876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.773097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.773193 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.773315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.773428 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.773617 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.773720 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.773936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.774036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.774264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797333-4-iscsi {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.774367 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.774587 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.774692 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.774900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.774991 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.775222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.775367 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.775540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.775705 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.775895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.776076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.776227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.776382 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.776550 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.776706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.776849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.777261 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.777518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.777627 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.777756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.777905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.778000 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.778216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.778315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.778535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.778637 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.778865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.778971 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.779182 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.779275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.779511 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.779612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.779865 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.780028 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.780193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.780348 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.780507 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.780662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.780909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797333-4-iscsi {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.781001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.781229 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.781389 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.781574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.781677 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.781895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.782007 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.782223 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.782329 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.782576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.782669 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.782916 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.783028 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.783208 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.783302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.783528 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.783628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.783838 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.783940 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.784156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.784323 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.784472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.784565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.784790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.784889 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.785106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.785208 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.785454 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.785553 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.785776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.785885 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.786094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.786195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.786411 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.786512 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.786716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.786820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.787022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.787159 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.787256 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.787342 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.787570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.787677 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.787891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.787991 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.788213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.788305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.788538 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.788646 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.788795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.788903 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.789057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.789539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.789748 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.789904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.790093 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.790093 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.790530 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.790816 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.791070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.791316 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.791558 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.791788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.792668 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.792937 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.793184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.793547 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.793733 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.793926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.794182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.794433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.794656 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.794884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.794884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.796055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.796307 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.796540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.796889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.797135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.797393 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.797624 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.797792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.797792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.798088 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.798342 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.798518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.798665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.798824 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.799061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.799224 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.799424 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.799691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.799930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.800084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.800228 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.800380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.800538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.800701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.800846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.801000 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.801140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.801279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.801476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.801633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.801772 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.801924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.802097 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.802244 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.802611 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.802762 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.802762 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.803026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.803219 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.803396 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.803550 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.803643 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.803738 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.803835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.803930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.804384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.804498 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.804595 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.804691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.804784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.804872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.804972 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.805060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.805060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.805233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.805423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.805524 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.805637 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.805735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.805829 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.805923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.806162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.806162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.806341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.806499 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.806654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.806751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.806861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.806958 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.807060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.807294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.807388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.807482 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.807569 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.807653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.807653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.808384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.808548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.808654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.808738 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.808811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.808891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.809034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.809134 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.809228 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.809337 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.809337 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.809565 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.809565 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.809776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.809776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.809943 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.810099 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.810246 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.810350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.810572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.810794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.810896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.811116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.811218 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.811440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.811545 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.811762 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.811856 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.812080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.812172 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.812389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.812483 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.812701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.812817 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.813008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.813109 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.813316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.813435 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.813644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.813737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.813952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.814053 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.814255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.814379 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.814577 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.814673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.814888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.814982 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.815199 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.815299 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.815511 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.815820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.816149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:33:38.816294 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.816469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.816578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.816792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.816897 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.817114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.817233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.817456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.817572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.817774 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.817880 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.818064 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.818174 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.818394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.818495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.818718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.818820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.819032 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.819140 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.819350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.819462 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.819672 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.819814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.819971 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.820065 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.820286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.820385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.820601 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.820701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.820911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.821012 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.821219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.821340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.821553 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.821648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.821863 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.821964 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.822171 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.822270 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.822498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.822592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.822813 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.822915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.823123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.823215 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.823461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.823577 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.823774 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.824046 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.824145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.824399 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.824519 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.824748 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.824845 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.825070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.825172 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.825431 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.825554 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.825763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.825867 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.826080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.826181 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.826397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.826491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.826714 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.826808 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.827025 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.827116 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.827354 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.827555 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.827658 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.827744 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.827987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.828091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.828275 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.828382 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.828585 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.828678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.828895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.828994 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.829212 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.829314 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.829551 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.829682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.829877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.829969 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.830200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.830302 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.830521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.830621 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.830830 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.830928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.831147 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.831246 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.831461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.831552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.831789 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.831926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.832103 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.832300 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.832420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.832620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.832740 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.832942 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.833086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.833259 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.833428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.833606 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.833735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.833926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.834061 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.834243 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.834375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.834556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.834683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.834875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.835011 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.835185 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.835309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.835493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.835619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.835845 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.835980 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.836118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.836246 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.836572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.836893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.837209 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.838483 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.838620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.838724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.838810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.838893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839037 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839210 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839412 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839569 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839657 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.839886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.840118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.840231 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.840422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.840529 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.840741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.840839 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.841059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.841154 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.841401 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.841500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.841732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.841826 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.842050 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.842155 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.842364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.842465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.842706 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.842807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.843043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.843151 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.843353 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.843455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.843683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.843779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.844001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.844107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.844320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.844414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.844629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.844730 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.844944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.845054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.845253 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.845457 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.845591 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.845694 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.845901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.846060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.846196 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.846329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.846510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.846639 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.846820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.846996 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.847133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.847317 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.847453 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.847632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.847784 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.848022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.848148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.848335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.848494 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.848637 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.848779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.848940 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.849098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.849242 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.849455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.849607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.849787 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.849926 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.850099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.850236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.850419 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.850565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.850737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.850983 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.851129 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.851317 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.851461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.851638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.851782 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.851959 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.852104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.852275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.852419 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.852592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.852741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.852906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.853049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.853221 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.853377 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.853560 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.853703 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.853874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.854071 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.854217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.854397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.854542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.855281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.855428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.855563 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.855882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.856028 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.856194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.856333 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.856505 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.856641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.856820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.856969 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.857129 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.857265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.857464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.857593 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.857793 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.857947 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.858104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.858240 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.858447 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.858593 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.858763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.858900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.859060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.859202 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.859372 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.859518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.859664 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.859805 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.859990 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.860166 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.860301 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.860415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.860608 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.860753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.860961 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.861094 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.861253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.861447 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.861649 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.861766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.861917 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.862039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.862240 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.862557 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.862857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.863022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.863172 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.863344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.863507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.863667 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.863821 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.863977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.864131 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.864319 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.864486 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.864648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.864797 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.864943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.865088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.865241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.865428 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.865679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.865834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.866010 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.866164 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.866310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.866472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.866640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.866786 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.866940 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.867095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.867249 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.867410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.867566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.867711 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.867857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.868003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.868156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.868316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.868478 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.868643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.868790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.868937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.869082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.869315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.869495 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.869643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.869788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.869936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.870096 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.870894 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.871110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.871295 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.871451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.871608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.871766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.871766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.872055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.872201 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.872361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.872508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.872669 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.872938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.873145 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.873309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.873553 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.873713 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.873870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.874025 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.874180 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.874336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.874493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.874650 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.874798 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.874944 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.875098 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.875254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.875407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.875579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.875734 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.875889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.876044 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.876198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.876599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.876758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.876913 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.877067 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.877224 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.877389 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.877542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.877706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.877872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.878019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.878175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.878322 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.878479 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.878636 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.878783 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.878936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.879082 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.879235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.879393 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.879393 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.879678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.879834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.879980 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.880133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.880289 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.880445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.880600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.880747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.880893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.881038 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.881198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.881413 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.881568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.881725 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.881870 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.882030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.882177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.882177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.882467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.882622 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.882778 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.882934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.883082 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.883228 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.883373 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.883519 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.883683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.883840 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.883996 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.884158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.884315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.884461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.884621 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.884769 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.884923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.885077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.885238 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.885415 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.885583 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.885739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.885932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.886097 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.886245 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.886400 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.886588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.886884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.886884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.887178 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.887326 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.887481 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.887655 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.887803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.887950 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.888115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.888270 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.888425 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.888578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.888733 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.888890 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.889052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.889199 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.889398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.889563 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.889723 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.889887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.890035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.890035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.890320 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.890469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.890622 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.890779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.890927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.891073 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.891219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.891365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.891529 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.891686 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.891840 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.891993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.892140 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.892293 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.892440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.892599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.892757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.892905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.893060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.893207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.893385 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.893556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.893705 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.893872 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.894035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.894194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.894351 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.894498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.894652 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.894799 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.894955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.895111 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.895259 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.895416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.895570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.895717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.895878 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.896025 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.896173 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.896318 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.896464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.896618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.896774 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.896922 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.897076 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.897232 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.897418 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.897582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.897738 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.897903 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.898058 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.898212 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.898360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.898516 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.898664 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.898810 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.898955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.899101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.899255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.899432 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.899580 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.899727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.899873 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.900027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.900174 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.900334 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.900490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.900645 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.900800 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.900948 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.901100 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.901262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.901471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.901638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.901974 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.901974 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.902273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.902429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.902429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.902708 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.902854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.903010 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.903176 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.903331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.903490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.903636 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.903792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.903939 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.904099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.904256 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.904409 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.904561 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.904714 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.904869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.905027 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.905181 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.905373 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.905548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.905697 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.905853 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.906000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.906146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.906349 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.906509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.906658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.906820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.906975 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.907121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.907275 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.907429 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.907593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.907751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.907898 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.908051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.908198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.908353 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.908508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.908665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.908821 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.908968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.909121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.909269 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.909452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.909611 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.909765 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.909921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.910075 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.910229 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.910391 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.910538 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.910684 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.910831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.910976 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.911122 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.911281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.911429 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.911585 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.911732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.911732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.912017 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.912176 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.912330 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.912484 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.912631 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.912784 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.912947 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.913101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.913248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.913469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.913628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.913784 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.913941 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.914089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.914235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.914431 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.914581 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.914735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.914896 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.915045 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.915190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.915344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.915509 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.915657 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.915821 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.915968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.916124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.916278 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.916424 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.916580 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.916735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.916890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.917037 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.917741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.917890 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.918136 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.918295 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.918451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.918605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.918605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.918902 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.919059 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.919207 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.919361 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.919516 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.919662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.919889 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.920049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.920196 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.920342 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.920496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.920643 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.920803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.921001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.921159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.921308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.921509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.921665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.921827 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.921975 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.922143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.922297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.922454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.922601 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.922763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.922921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.923071 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.923218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.923380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.923538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.923687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.923687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.923985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.924133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.924287 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.924448 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.924636 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.924791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.924968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.925123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.925271 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.925457 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.925615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.925763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.925909 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.925909 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.926208 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.926357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.926502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.926649 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.926794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.926950 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.927106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.927261 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.927408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.927561 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.927724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.927882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.928043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.928197 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.928344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.928490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.928646 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.928801 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.928962 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.929124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.929271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.929452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.929599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.929759 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.929917 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.930063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.930208 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.930354 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.930509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.930671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.930827 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.930973 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.931119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.931273 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.931419 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.931577 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.931731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.931889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.932043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.932189 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.932343 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.932500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.932654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.932958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.933166 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.933388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.933388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.933752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.933938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.934087 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.934255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.934255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.934556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.934704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.934704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.935001 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.935149 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.935294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.935455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.935604 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.935758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.935905 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.936062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.936217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.936375 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.936530 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.936677 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.936823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.936969 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.937131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.937286 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.937469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.937626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.937774 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.937928 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.938096 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.938252 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.938409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.938562 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.938717 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.938872 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.939029 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.939177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.939323 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.939478 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.939633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.939787 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.939944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.940103 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.940250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.940403 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.940557 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.940720 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.940883 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.941044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.941206 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.941433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.941594 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.941759 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.941913 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.942085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.942085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.942085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.942524 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.942694 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.942855 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.943009 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.943168 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.943330 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.943495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.943648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.943801 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.943961 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.944126 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.944280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.944444 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.944605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.944776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.944938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.945098 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.945260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.945466 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.945623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.945776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.945928 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.946091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.946251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.946419 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.946575 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.946734 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.946888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.947040 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.947203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.947357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.947518 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.947680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.947834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.947986 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.948160 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.948837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.949011 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.949230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.949476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.949635 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.949883 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.949883 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.950178 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.950338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.950492 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.950653 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.950653 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:33:38.950978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.950978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.950978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.951436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.951974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.952540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.952872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.953223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.953608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.953936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.954267 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.954605 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.954924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.955241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.955564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.955879 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.956192 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.956504 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.956822 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.957133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.957469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.957776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.958105 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.958415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.958739 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.959057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.959368 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.959679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.959987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.960333 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.960643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.960979 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.961304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.961743 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.962472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.962795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.965361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.965361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.965361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.965361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.965361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.965361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.965867 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.965867 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.966128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.966455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.966779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.967107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.967682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.968016 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.968340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.968661 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.968981 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.969301 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.969658 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.969978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.970296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.970614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.970979 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.971262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.971589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.971955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.972633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.972961 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.973284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.973634 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.973956 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.974320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.974642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.974954 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.975274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.975596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.975918 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.976235 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.976551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.976869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.977186 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.977556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.977878 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.978197 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.979052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.979052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.979052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.980129 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.980365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.980936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.981382 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.981929 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.982685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.983032 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.983368 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.983702 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.984411 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.984411 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.984741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.984972 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.985284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.985644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.985961 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.986273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.986600 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.987091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.987412 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.987742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.988057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.988614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.988970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.989292 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.989648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.989977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.990299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.990611 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.990939 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.991249 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.991559 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.991879 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.992268 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.992811 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.993093 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.993349 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.993685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.993995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.994312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.994620 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.994953 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.995930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.996478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.996991 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.997361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.997666 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.997981 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.998293 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.998605 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.998924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.999233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.999549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:38.999858 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.000173 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.000481 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.000795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.001155 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.001768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.002084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.002407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.002946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.003229 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.003552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.003873 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.004192 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.004547 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.004870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.005458 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.005797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.006121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.006459 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.006794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.007102 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.007412 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.007720 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.008050 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.008366 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.008681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.008997 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.009314 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.009649 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.009961 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.010276 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.010588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.010938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.011520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.012097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.012488 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.012952 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.017228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.017228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.017228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.017228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.017228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.017228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.017228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.017228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.018596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.018596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.018596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.018596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.018596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.019352 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO dbcounter [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Registered counter for database nova_api Jun 17 07:33:39.019523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.019523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.019523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.019523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.019523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.019523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.019523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.020551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.020551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.020551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.020551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.021128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.021128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.021496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.021803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.022114 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.022430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.022740 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.023177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.023877 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.023877 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.024194 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.024397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.024712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.025021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.025357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.025658 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.025967 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.026280 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.026731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.027344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.027721 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.028034 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.028346 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.028655 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.028971 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.029280 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.029619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.029925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.030234 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.030538 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.030872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.031205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.031526 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.031928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.033203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.034079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.036482 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.036908 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.037244 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.037645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_db.sqlalchemy.engines [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:33:39.037939 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.038152 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.038691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.039027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.039361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.039854 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.040365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.040876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.041966 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.042680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.043060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.044307 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.044307 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.044670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.044835 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.044989 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writer thread running {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:33:39.045156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.045604 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.046093 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.046428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.046754 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.047086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.047410 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.047737 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.048064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.048393 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.048729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.049064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.049408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.049775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.050074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.050432 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.050753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.051106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.051442 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.051763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.052083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.052396 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:33:39.052646 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124472) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:33:39.102708 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.context [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d9e8a95-f347-4e57-9496-74641ae5645e(cell1) {{(pid=124471) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 07:33:39.107724 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:33:39.109254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:33:39.110100 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:33:39.112052 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:33:39.114043 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO dbcounter [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Registered counter for database nova_cell0 Jun 17 07:33:39.117944 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO dbcounter [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Registered counter for database nova_cell1 Jun 17 07:33:39.118088 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO dbcounter [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Registered counter for database nova_api Jun 17 07:33:39.126562 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_db.sqlalchemy.engines [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:33:39.128315 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_db.sqlalchemy.engines [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:33:39.134099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writer thread running {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:33:39.136962 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writer thread running {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:33:39.138948 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:33:39.145462 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writer thread running {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:33:39.203782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.context [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d9e8a95-f347-4e57-9496-74641ae5645e(cell1) {{(pid=124472) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 07:33:39.207859 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:33:39.209465 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:33:39.210279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:33:39.212234 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:33:39.214929 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO dbcounter [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Registered counter for database nova_cell0 Jun 17 07:33:39.218975 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO dbcounter [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Registered counter for database nova_cell1 Jun 17 07:33:39.226439 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:33:39.228227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:33:39.235230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writer thread running {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:33:39.237355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writer thread running {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:33:39.282501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO dbcounter [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Registered counter for database nova_cell0 Jun 17 07:33:39.290207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_db.sqlalchemy.engines [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:33:39.295382 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writer thread running {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:33:39.386209 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO dbcounter [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Registered counter for database nova_cell0 Jun 17 07:33:39.393190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_db.sqlalchemy.engines [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124472) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:33:39.397700 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writer thread running {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:33:39.610466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: WARNING keystonemiddleware.auth_token [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:33:39.617693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: WARNING keystonemiddleware.auth_token [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:33:39.721845 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: WARNING keystonemiddleware.auth_token [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:33:39.729075 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: WARNING keystonemiddleware.auth_token [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:33:39.959371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: WARNING keystonemiddleware.auth_token [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:33:39.966120 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: WARNING keystonemiddleware.auth_token [None req-a1731339-bd63-4c85-95b3-3b35f66c8e2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:33:39.971588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a0696e9c0 pid: 124471 (default app) Jun 17 07:33:40.082388 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: WARNING keystonemiddleware.auth_token [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:33:40.088386 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: WARNING keystonemiddleware.auth_token [None req-f4a5e98f-eda5-4118-a216-09a02ee2936b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:33:40.094608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a0696e9c0 pid: 124472 (default app) Jun 17 07:34:21.655935 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:21.664571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:21.664571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:21.664571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:22.048433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:22.049548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:22.050781 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:22.051776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:23.258406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-40cbfb57-22e3-4c1f-a496-45f6364da124 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Action: 'create', calling method: .version_select at 0x7fb06bc74790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1483204367"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:23.398725 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-30754faf-f694-4f62-aac4-a677993aa835 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Action: 'create', calling method: .version_select at 0x7fb06bc74820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1571652776", "metadata": {"Type": "work"}}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-30754faf-f694-4f62-aac4-a677993aa835 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Request method failure captured: Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 122 Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC59XAcqyCntY7KfIbGd7mPCqQeyDl9G2PTqT_K5m9TS9x6rTYZR3jGMr6_GYuNm-DdALt-agMRKCKuR_SmJDY6blJ2Zjl4HG50ExPdXrk7nxOQaZ5T2Ak9f7GFu2MXoL-v_rquXfBSufek1GKTQE2WhFvVBilKDuuSaFMwpfUUqz9M Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:34:23.492480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 1b6726b31b0d4265bee3691bd9034980 Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1571652776", "metadata": {"Type": "work"}}} Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: Jun 17 07:34:23.503876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1571652776', 'metadata': {'Type': 'work'}}}} Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise error Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi '#$%' Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:23.505650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 07:34:23.507440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-30754faf-f694-4f62-aac4-a677993aa835 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-30754faf-f694-4f62-aac4-a677993aa835 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.428090 Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Fri Jun 17 07:34:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1430 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c65c6ccb-f0e3-463e-b149-0f9f417529e7 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Action: 'create', calling method: .version_select at 0x7fb06bbbcaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1493721946", "metadata": {"Type": "work"}}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c65c6ccb-f0e3-463e-b149-0f9f417529e7 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Request method failure captured: Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 07:34:23.510570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 120 Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC59XAcqyCntY7KfIbGd7mPCqQeyDl9G2PTqT_K5m9TS9x6rTYZR3jGMr6_GYuNm-DdALt-agMRKCKuR_SmJDY6blJ2Zjl4HG50ExPdXrk7nxOQaZ5T2Ak9f7GFu2MXoL-v_rquXfBSufek1GKTQE2WhFvVBilKDuuSaFMwpfUUqz9M Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:34:23.512282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 1b6726b31b0d4265bee3691bd9034980 Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1493721946", "metadata": {"Type": "work"}}} Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1493721946', 'metadata': {'Type': 'work'}}}} Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise error Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi '0' Jun 17 07:34:23.516204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.521454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c65c6ccb-f0e3-463e-b149-0f9f417529e7 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c65c6ccb-f0e3-463e-b149-0f9f417529e7 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018041 Jun 17 07:34:23.524761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1155 bytes} [Fri Jun 17 07:34:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bd339bda-dcdc-40a4-a3be-1a1a4b0ce85e tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Action: 'create', calling method: .version_select at 0x7fb06bc74b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-937076970", "metadata": {"Type": "work"}}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bd339bda-dcdc-40a4-a3be-1a1a4b0ce85e tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Request method failure captured: Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 118 Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC59XAcqyCntY7KfIbGd7mPCqQeyDl9G2PTqT_K5m9TS9x6rTYZR3jGMr6_GYuNm-DdALt-agMRKCKuR_SmJDY6blJ2Zjl4HG50ExPdXrk7nxOQaZ5T2Ak9f7GFu2MXoL-v_rquXfBSufek1GKTQE2WhFvVBilKDuuSaFMwpfUUqz9M Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:34:23.527793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 1b6726b31b0d4265bee3691bd9034980 Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-937076970", "metadata": {"Type": "work"}}} Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: Jun 17 07:34:23.532079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-937076970', 'metadata': {'Type': 'work'}}}} Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise error Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi '' Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:23.532875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 07:34:23.534271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 07:34:23.535491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 07:34:23.535491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:23.535491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bd339bda-dcdc-40a4-a3be-1a1a4b0ce85e tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:23.535491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-bd339bda-dcdc-40a4-a3be-1a1a4b0ce85e tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032880 Jun 17 07:34:23.537458 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1155 bytes} [Fri Jun 17 07:34:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 07:34:23.547074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f9e51122-318c-4605-a980-9a41fa081ced tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Calling method '.version_select at 0x7fb06bba2790>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:26.247069 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-f9e51122-318c-4605-a980-9a41fa081ced tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] HTTP exception thrown: Volume tempest-invalid-755076420 could not be found. Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f9e51122-318c-4605-a980-9a41fa081ced tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Request method failure captured: Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-755076420 HTTP/1.1 Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC59XAcqyCntY7KfIbGd7mPCqQeyDl9G2PTqT_K5m9TS9x6rTYZR3jGMr6_GYuNm-DdALt-agMRKCKuR_SmJDY6blJ2Zjl4HG50ExPdXrk7nxOQaZ5T2Ak9f7GFu2MXoL-v_rquXfBSufek1GKTQE2WhFvVBilKDuuSaFMwpfUUqz9M Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:34:26.251682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 1b6726b31b0d4265bee3691bd9034980 Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Volume tempest-invalid-755076420 could not be found. Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'tempest-invalid-755076420'} Jun 17 07:34:26.252955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-755076420 could not be found. (HTTP 404) (Request-ID: req-e4914828-3b44-45ce-a580-97ce79dbc0f6) Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:26.253699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:34:26.254764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-755076420 could not be found. Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:34:26.256455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-755076420 could not be found. Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-755076420 could not be found. Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f9e51122-318c-4605-a980-9a41fa081ced tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Returning 404 to user: Volume tempest-invalid-755076420 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:26.259642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f9e51122-318c-4605-a980-9a41fa081ced tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-755076420" status: 404 len: 98 microversion: 2.1 time: 2.710254 Jun 17 07:34:26.264777 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1214 bytes} [Fri Jun 17 07:34:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-755076420 => generated 98 bytes in 2719 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 17 07:34:26.274835 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2482336d-f419-4b34-9144-d3ca1c3b5476 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004228 Jun 17 07:34:26.282527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1139 bytes} [Fri Jun 17 07:34:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 07:34:26.297399 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4dedbf94-3915-4745-a8b5-cb5a8950fd1f tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013724 Jun 17 07:34:26.299518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 6/6] 10.222.0.52 () {58 vars in 1136 bytes} [Fri Jun 17 07:34:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 07:34:26.312629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d1f5c730-14da-40fa-b97f-de4c5c9e1da1 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Calling method '.version_select at 0x7fb06bacfb80>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:26.948978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-d1f5c730-14da-40fa-b97f-de4c5c9e1da1 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] HTTP exception thrown: Volume bac8e1dd-9b08-43d3-83be-d97a183327e0 could not be found. Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d1f5c730-14da-40fa-b97f-de4c5c9e1da1 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Request method failure captured: Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/os-volumes/bac8e1dd-9b08-43d3-83be-d97a183327e0 HTTP/1.1 Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC59XAcqyCntY7KfIbGd7mPCqQeyDl9G2PTqT_K5m9TS9x6rTYZR3jGMr6_GYuNm-DdALt-agMRKCKuR_SmJDY6blJ2Zjl4HG50ExPdXrk7nxOQaZ5T2Ak9f7GFu2MXoL-v_rquXfBSufek1GKTQE2WhFvVBilKDuuSaFMwpfUUqz9M Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:34:26.951842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 1b6726b31b0d4265bee3691bd9034980 Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Volume bac8e1dd-9b08-43d3-83be-d97a183327e0 could not be found. Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'bac8e1dd-9b08-43d3-83be-d97a183327e0'} Jun 17 07:34:26.958665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bac8e1dd-9b08-43d3-83be-d97a183327e0 could not be found. (HTTP 404) (Request-ID: req-f19f4bd2-58ed-4567-843e-a33fec6f6cd0) Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:26.959420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:34:26.960262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bac8e1dd-9b08-43d3-83be-d97a183327e0 could not be found. Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 07:34:26.961117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bac8e1dd-9b08-43d3-83be-d97a183327e0 could not be found. Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bac8e1dd-9b08-43d3-83be-d97a183327e0 could not be found. Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d1f5c730-14da-40fa-b97f-de4c5c9e1da1 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Returning 404 to user: Volume bac8e1dd-9b08-43d3-83be-d97a183327e0 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d1f5c730-14da-40fa-b97f-de4c5c9e1da1 tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/bac8e1dd-9b08-43d3-83be-d97a183327e0" status: 404 len: 109 microversion: 2.1 time: 0.645575 Jun 17 07:34:26.962017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 7/7] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:34:26 2022] DELETE /compute/v2.1/os-volumes/bac8e1dd-9b08-43d3-83be-d97a183327e0 => generated 109 bytes in 647 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:34:26.962666 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-40cbfb57-22e3-4c1f-a496-45f6364da124 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 5.311206 Jun 17 07:34:26.962666 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 1/8] 10.222.0.52 () {60 vars in 1154 bytes} [Fri Jun 17 07:34:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 5314 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 07:34:26.972386 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d755b6b9-9fef-4888-98a5-410457f3daac tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Calling method '.version_select at 0x7fb06bacf700>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:26.976431 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8459a563-02df-4b7b-94a7-41a620d87da4 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06bb3e5e0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:27.251194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8459a563-02df-4b7b-94a7-41a620d87da4 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6" status: 200 len: 345 microversion: 2.1 time: 0.281488 Jun 17 07:34:27.253343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 2/9] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:34:26 2022] GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 => generated 345 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:27.287549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-d755b6b9-9fef-4888-98a5-410457f3daac tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] HTTP exception thrown: Volume f3c54100-2d5b-4422-8f85-542690568998 could not be found. Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d755b6b9-9fef-4888-98a5-410457f3daac tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Request method failure captured: Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/os-volumes/f3c54100-2d5b-4422-8f85-542690568998 HTTP/1.1 Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC59XAcqyCntY7KfIbGd7mPCqQeyDl9G2PTqT_K5m9TS9x6rTYZR3jGMr6_GYuNm-DdALt-agMRKCKuR_SmJDY6blJ2Zjl4HG50ExPdXrk7nxOQaZ5T2Ak9f7GFu2MXoL-v_rquXfBSufek1GKTQE2WhFvVBilKDuuSaFMwpfUUqz9M Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:34:27.289995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/be14ecaa27b14457b8e0c29a65de7066"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: be14ecaa27b14457b8e0c29a65de7066 Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-VolumesNegativeTest-1213837078 Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 1b6726b31b0d4265bee3691bd9034980 Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-VolumesNegativeTest-1213837078-project Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Volume f3c54100-2d5b-4422-8f85-542690568998 could not be found. Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'f3c54100-2d5b-4422-8f85-542690568998'} Jun 17 07:34:27.291893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3c54100-2d5b-4422-8f85-542690568998 could not be found. (HTTP 404) (Request-ID: req-650f842f-4f5d-40cb-87c0-8bf4880e8fee) Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:27.292751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:34:27.295324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3c54100-2d5b-4422-8f85-542690568998 could not be found. Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 07:34:27.298226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3c54100-2d5b-4422-8f85-542690568998 could not be found. Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3c54100-2d5b-4422-8f85-542690568998 could not be found. Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d755b6b9-9fef-4888-98a5-410457f3daac tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] Returning 404 to user: Volume f3c54100-2d5b-4422-8f85-542690568998 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d755b6b9-9fef-4888-98a5-410457f3daac tempest-VolumesNegativeTest-1213837078 tempest-VolumesNegativeTest-1213837078-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f3c54100-2d5b-4422-8f85-542690568998" status: 404 len: 109 microversion: 2.1 time: 0.332453 Jun 17 07:34:27.300834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 8/10] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:34:26 2022] GET /compute/v2.1/os-volumes/f3c54100-2d5b-4422-8f85-542690568998 => generated 109 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:34:28.264800 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2be85f47-f6bd-4710-9fa9-b107ddea686a tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06bb3e700>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:28.463549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2be85f47-f6bd-4710-9fa9-b107ddea686a tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6" status: 200 len: 346 microversion: 2.1 time: 0.202805 Jun 17 07:34:28.464538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 3/11] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:34:28 2022] GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 => generated 346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:28.476027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9e2ee3b0-c8b4-45c0-b083-da319e65f1e8 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Action: 'create', calling method: .version_select at 0x7fb06bacfa60>, body: {"snapshot": {"volume_id": "a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-641590688"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:29.327587 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9e2ee3b0-c8b4-45c0-b083-da319e65f1e8 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.855761 Jun 17 07:34:29.338030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 9/12] 10.222.0.52 () {60 vars in 1161 bytes} [Fri Jun 17 07:34:28 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:29.339644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-216662af-effa-4f2f-85da-eb1b94f13c14 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06bb3ed30>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:29.479766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-216662af-effa-4f2f-85da-eb1b94f13c14 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.144702 Jun 17 07:34:29.489770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 4/13] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:29 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:29.491589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5c670a2c-4634-4192-9b17-1b750f4a579d tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06badca60>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:29.620396 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5c670a2c-4634-4192-9b17-1b750f4a579d tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.132800 Jun 17 07:34:29.631931 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cd999a66-1833-45ee-b48f-5c09fe240cbe tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06bb524c0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:29.633680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 10/14] 10.222.0.52 () {58 vars in 1139 bytes} [Fri Jun 17 07:34:29 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:29.714871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cd999a66-1833-45ee-b48f-5c09fe240cbe tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.086820 Jun 17 07:34:29.720003 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 5/15] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:29 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:30.727785 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ef7da3dc-9d98-467c-8907-91c69ea657ae tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06ba71700>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:30.784789 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ef7da3dc-9d98-467c-8907-91c69ea657ae tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.061449 Jun 17 07:34:30.791922 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 11/16] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:30 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:31.807720 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-55f43baa-867b-4432-87c0-fc10fab093fb tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06bb3ed30>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:31.867591 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-55f43baa-867b-4432-87c0-fc10fab093fb tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.073164 Jun 17 07:34:31.874067 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 6/17] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:31 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:32.799048 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1232130781", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:32.880850 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3d11229a-5c43-4a1e-af8b-47378b6af4d0 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06bb3e700>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:32.985747 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3d11229a-5c43-4a1e-af8b-47378b6af4d0 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.109152 Jun 17 07:34:32.987135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 7/18] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:32 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:33.066970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] validate_networks() for [('315e52c5-a70d-404e-b206-282d7a7fd5b1', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:34:33.213987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-89928177", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "networks": [{"uuid": "023de6ba-26d3-417f-9faa-77d1115e3296"}]}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:33.427895 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] validate_networks() for [('023de6ba-26d3-417f-9faa-77d1115e3296', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:34:34.612980 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:34:34.613565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:34:34.613880 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:34:34.614286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:34:34.614688 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:34:34.640768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:34.641476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:34.642163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:34.642595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:34.734394 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Getting quotas for project 94fc753fb51e41acb3037d2ca7cd1394. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:34:34.762671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Getting quotas for user 8b753148f55e4fb0897bf9639e8d4d70 and project 94fc753fb51e41acb3037d2ca7cd1394. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:34:34.813066 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:34:34.820948 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:34:35.096514 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9600f0e7-db1b-4be7-ba1a-d3119e07914c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.862233 Jun 17 07:34:35.097168 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 12/19] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:34:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:34:35.104016 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-223a1b95-6ab7-4d8a-9e60-a2898acc6223 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06b9d7700>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:35.170282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-223a1b95-6ab7-4d8a-9e60-a2898acc6223 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.071470 Jun 17 07:34:35.174374 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 13/20] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:35 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:35.178980 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b4e4c045-b4b7-4f63-973f-c83546f677ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:35.178980 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b4e4c045-b4b7-4f63-973f-c83546f677ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:35.365172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b4e4c045-b4b7-4f63-973f-c83546f677ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:35.415398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b4e4c045-b4b7-4f63-973f-c83546f677ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1222 microversion: 2.1 time: 0.243012 Jun 17 07:34:35.422950 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 14/21] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:35 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1222 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:35.581080 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:34:35.582868 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:34:35.583584 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:34:35.584213 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:34:35.584781 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:34:35.631137 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:35.636425 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:35.637357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:35.639444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:35.722255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Getting quotas for project 1d57351560654accb09e975bbc8dcf17. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:34:35.764245 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Getting quotas for user 3e7b9aa8532b47afafeb7481932bfce9 and project 1d57351560654accb09e975bbc8dcf17. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:34:35.787742 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:34:35.791799 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:34:35.844968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1848712787", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:35.974996 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] validate_networks() for [('315e52c5-a70d-404e-b206-282d7a7fd5b1', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:34:36.146679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d8bc3c22-d767-44e5-a25a-5a64bc0a7e2b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.158007 Jun 17 07:34:36.147544 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 8/22] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:34:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:34:36.159496 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d1c277cd-1959-4d8a-aff7-fbf776b1f354 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:36.160102 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d1c277cd-1959-4d8a-aff7-fbf776b1f354 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:36.426661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d1c277cd-1959-4d8a-aff7-fbf776b1f354 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:36.450487 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d1c277cd-1959-4d8a-aff7-fbf776b1f354 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1213 microversion: 2.1 time: 0.294942 Jun 17 07:34:36.466530 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 9/23] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:36 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1213 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:34:36.480619 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9fbc1695-c0d2-4099-9ade-3699df3824d9 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a9fc550>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:36.568555 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9fbc1695-c0d2-4099-9ade-3699df3824d9 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 287 microversion: 2.1 time: 0.100705 Jun 17 07:34:36.569369 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 10/24] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:36 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:36.582316 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f9043281-9ec6-466e-bcf6-f75c727da84e tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06aa108b0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:36.857922 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f9043281-9ec6-466e-bcf6-f75c727da84e tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 202 len: 0 microversion: 2.1 time: 0.281069 Jun 17 07:34:36.862582 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 11/25] 10.222.0.52 () {58 vars in 1253 bytes} [Fri Jun 17 07:34:36 2022] DELETE /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:34:36.869108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b15888ef-2870-4f4f-9a36-ee4fb4ec3dbc tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06aa10f70>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:36.966601 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b15888ef-2870-4f4f-9a36-ee4fb4ec3dbc tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.102325 Jun 17 07:34:36.967257 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 12/26] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:36 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:37.489959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c959f02b-2f66-474b-9fa8-d3c35d9f545e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:37.491727 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c959f02b-2f66-474b-9fa8-d3c35d9f545e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:37.541235 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:34:37.543227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:34:37.543731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:34:37.550282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:34:37.550282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:34:37.586088 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:37.586572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:37.587504 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:37.596069 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:37.607647 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c959f02b-2f66-474b-9fa8-d3c35d9f545e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:37.619789 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c959f02b-2f66-474b-9fa8-d3c35d9f545e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1213 microversion: 2.1 time: 0.149859 Jun 17 07:34:37.620254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 13/27] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:37 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:37.684160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Getting quotas for project 94fc753fb51e41acb3037d2ca7cd1394. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:34:37.700783 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Getting quotas for user 8b753148f55e4fb0897bf9639e8d4d70 and project 94fc753fb51e41acb3037d2ca7cd1394. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:34:37.745297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:34:37.758588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:34:37.977364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-17675a23-7287-4b23-b962-56668abca308 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.159320 Jun 17 07:34:37.977998 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-331c8c1e-feeb-4894-9b32-0ba52516699d tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a9fc550>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:37.979053 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 15/28] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:34:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:34:37.993072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8a490705-45c5-4943-bcad-fbbaf3cb0bfc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:37.995225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8a490705-45c5-4943-bcad-fbbaf3cb0bfc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:38.160355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-331c8c1e-feeb-4894-9b32-0ba52516699d tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.186371 Jun 17 07:34:38.161068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 14/29] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:37 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:38.319729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8a490705-45c5-4943-bcad-fbbaf3cb0bfc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:38.331919 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8a490705-45c5-4943-bcad-fbbaf3cb0bfc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1222 microversion: 2.1 time: 0.344700 Jun 17 07:34:38.346007 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 16/30] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:37 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1222 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:38.644259 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-165885f7-5db8-4225-82c0-0a9a1424b846 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:38.645706 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-165885f7-5db8-4225-82c0-0a9a1424b846 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:38.810131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-165885f7-5db8-4225-82c0-0a9a1424b846 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:38.819552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-165885f7-5db8-4225-82c0-0a9a1424b846 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1213 microversion: 2.1 time: 0.186072 Jun 17 07:34:38.822299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 17/31] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:38 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:38.908554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f0e68e7e-80ea-4fb9-92ff-f87b86fb36fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'create', calling method: .version_select at 0x7fb06aa211f0>, body: {"keypair": {"name": "tempest-keypair-751308533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWlU/hra3atakhvNAUc0jpEi1ReukmQH30hMu1gJQq2BmcNLgq3OeB4u1/iAqVy/5s6sVBicxSfdxC0uO5RjI/kKPPYnj0OkryCFdlbXiDGQAV6HD14lScOYW9An4jrzg=="}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:38.997435 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-f0e68e7e-80ea-4fb9-92ff-f87b86fb36fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Getting quotas for project 8432e3c517624c449606ca1201f2be12. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:34:39.019159 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-f0e68e7e-80ea-4fb9-92ff-f87b86fb36fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Getting quotas for user a3ea40ad7d7546449f60539341abc545 and project 8432e3c517624c449606ca1201f2be12. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:34:39.174287 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e691ff93-5634-4ecd-9434-582cf9fb7a3b tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a98df70>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:39.217667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f0e68e7e-80ea-4fb9-92ff-f87b86fb36fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.947606 Jun 17 07:34:39.222003 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 15/32] 10.222.0.52 () {62 vars in 1199 bytes} [Fri Jun 17 07:34:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 950 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 07:34:39.302945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e691ff93-5634-4ecd-9434-582cf9fb7a3b tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.133635 Jun 17 07:34:39.307747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 18/33] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:39 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:39.365991 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-112cc36b-eecf-480b-9a6f-0dcfe97fb5ba tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:39.367551 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-112cc36b-eecf-480b-9a6f-0dcfe97fb5ba tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:39.466357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-112cc36b-eecf-480b-9a6f-0dcfe97fb5ba tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:39.479912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-112cc36b-eecf-480b-9a6f-0dcfe97fb5ba tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1222 microversion: 2.1 time: 0.121584 Jun 17 07:34:39.495664 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 16/34] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:39 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:34:39.844662 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a3d71009-1507-4762-b7bb-551af6252eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:39.845301 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a3d71009-1507-4762-b7bb-551af6252eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:39.872512 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3d71009-1507-4762-b7bb-551af6252eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:39.874499 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3d71009-1507-4762-b7bb-551af6252eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:39.883448 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3d71009-1507-4762-b7bb-551af6252eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:39.883993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3d71009-1507-4762-b7bb-551af6252eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:40.101236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a3d71009-1507-4762-b7bb-551af6252eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:40.125462 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a3d71009-1507-4762-b7bb-551af6252eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1217 microversion: 2.1 time: 0.291074 Jun 17 07:34:40.136812 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 19/35] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:39 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1217 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:40.317098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-48c0c594-6134-4c26-835d-b9ab8e4292b4 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a9bc5e0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:40.379679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-48c0c594-6134-4c26-835d-b9ab8e4292b4 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 200 len: 286 microversion: 2.1 time: 0.067314 Jun 17 07:34:40.381220 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 17/36] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:40 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:40.500393 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cf155381-d550-4a78-a2ca-fdaa97270041 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:40.501003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cf155381-d550-4a78-a2ca-fdaa97270041 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:40.507461 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cf155381-d550-4a78-a2ca-fdaa97270041 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:40.508137 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cf155381-d550-4a78-a2ca-fdaa97270041 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:40.509303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cf155381-d550-4a78-a2ca-fdaa97270041 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:40.510157 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cf155381-d550-4a78-a2ca-fdaa97270041 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:40.630223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cf155381-d550-4a78-a2ca-fdaa97270041 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:40.642879 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cf155381-d550-4a78-a2ca-fdaa97270041 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1218 microversion: 2.1 time: 0.145332 Jun 17 07:34:40.644681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 20/37] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:40 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:34:41.147777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-52f9f1da-9117-4836-8f69-003c98bfd70b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:41.150483 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-52f9f1da-9117-4836-8f69-003c98bfd70b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:41.173063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-52f9f1da-9117-4836-8f69-003c98bfd70b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:41.178802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-52f9f1da-9117-4836-8f69-003c98bfd70b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:41.178802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-52f9f1da-9117-4836-8f69-003c98bfd70b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:41.178802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-52f9f1da-9117-4836-8f69-003c98bfd70b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:41.393644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b9095798-dd6c-4db5-a7c2-edc391ffd534 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a8ff820>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:41.430888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-52f9f1da-9117-4836-8f69-003c98bfd70b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:41.458392 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-52f9f1da-9117-4836-8f69-003c98bfd70b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1265 microversion: 2.1 time: 0.318410 Jun 17 07:34:41.462837 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 18/38] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:41 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:41.555873 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-b9095798-dd6c-4db5-a7c2-edc391ffd534 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] HTTP exception thrown: Snapshot 7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b could not be found. Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b9095798-dd6c-4db5-a7c2-edc391ffd534 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Request method failure captured: Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b HTTP/1.1 Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC5965Qhb8oDsFjPOhM5kt2qz-sq2SnSHMmxuGAGg5JLkJT8Fk3JXqQeULP7mBG9LEwFHZI62PouE5EaXCBj1iAqwI2Hq7rdBH-judX0UiEer4XsRYj3G5iOe0SSofvLRXxdeSurJrACehWvUd3fvKeXWxgPZht93HMz2cyuOpH67xU Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 48a9b5852b69438eac339b063882d08c Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:34:41.558895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48a9b5852b69438eac339b063882d08c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48a9b5852b69438eac339b063882d08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48a9b5852b69438eac339b063882d08c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48a9b5852b69438eac339b063882d08c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 48a9b5852b69438eac339b063882d08c Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-VolumesSnapshotsTestJSON-1932656942-project Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 99687792e2714e4b8db1b6e699901dfe Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1932656942-project Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Snapshot 7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b could not be found. Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b'} Jun 17 07:34:41.559998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b could not be found. (HTTP 404) (Request-ID: req-5507d154-6945-4cb0-975f-abcb494a88a0) Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:41.561027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:34:41.562111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b could not be found. Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 17 07:34:41.563079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b could not be found. Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b could not be found. Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b9095798-dd6c-4db5-a7c2-edc391ffd534 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Returning 404 to user: Snapshot 7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:41.564020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b9095798-dd6c-4db5-a7c2-edc391ffd534 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b" status: 404 len: 111 microversion: 2.1 time: 0.171550 Jun 17 07:34:41.564857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 21/39] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:34:41 2022] GET /compute/v2.1/os-snapshots/7c9b82e6-d6a9-48ca-af48-c0a6ea55ef3b => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:34:41.572709 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-148f65b7-7066-4dc0-b7f9-bb46f6e78696 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a15e0d0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:41.662125 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-16fd9a0e-a248-4da0-8305-aed5042e7e0d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:41.662956 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-16fd9a0e-a248-4da0-8305-aed5042e7e0d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:41.678361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-16fd9a0e-a248-4da0-8305-aed5042e7e0d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:41.682166 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-16fd9a0e-a248-4da0-8305-aed5042e7e0d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:41.683172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-16fd9a0e-a248-4da0-8305-aed5042e7e0d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:41.683763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-16fd9a0e-a248-4da0-8305-aed5042e7e0d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:42.171319 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-16fd9a0e-a248-4da0-8305-aed5042e7e0d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:42.186294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-16fd9a0e-a248-4da0-8305-aed5042e7e0d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1274 microversion: 2.1 time: 0.524439 Jun 17 07:34:42.190498 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 22/40] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:41 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1274 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:42.197352 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-148f65b7-7066-4dc0-b7f9-bb46f6e78696 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6" status: 202 len: 0 microversion: 2.1 time: 0.631391 Jun 17 07:34:42.197933 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 19/41] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:34:41 2022] DELETE /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 07:34:42.209384 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9fbd1dad-d6f3-409d-bede-04e01eb7b994 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a913280>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:42.481251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-039cfc31-c77f-499c-9d78-b49a850ebec5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:42.482048 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-039cfc31-c77f-499c-9d78-b49a850ebec5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:42.502483 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-039cfc31-c77f-499c-9d78-b49a850ebec5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:42.503294 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-039cfc31-c77f-499c-9d78-b49a850ebec5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:42.504963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-039cfc31-c77f-499c-9d78-b49a850ebec5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:42.507354 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-039cfc31-c77f-499c-9d78-b49a850ebec5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:42.567733 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9fbd1dad-d6f3-409d-bede-04e01eb7b994 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6" status: 200 len: 345 microversion: 2.1 time: 0.365273 Jun 17 07:34:42.573903 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 23/42] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:34:42 2022] GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 => generated 345 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:34:42.706799 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-039cfc31-c77f-499c-9d78-b49a850ebec5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:42.721847 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-039cfc31-c77f-499c-9d78-b49a850ebec5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1283 microversion: 2.1 time: 0.241389 Jun 17 07:34:42.725397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 20/43] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:42 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1283 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:34:43.206909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9c8066bd-ea84-4c94-ae34-7315736eb52b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:43.208431 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9c8066bd-ea84-4c94-ae34-7315736eb52b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:43.218223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9c8066bd-ea84-4c94-ae34-7315736eb52b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:43.218837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9c8066bd-ea84-4c94-ae34-7315736eb52b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:43.219789 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9c8066bd-ea84-4c94-ae34-7315736eb52b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:43.221001 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9c8066bd-ea84-4c94-ae34-7315736eb52b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:43.412714 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9c8066bd-ea84-4c94-ae34-7315736eb52b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:43.423769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9c8066bd-ea84-4c94-ae34-7315736eb52b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1280 microversion: 2.1 time: 0.221671 Jun 17 07:34:43.429469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 24/44] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:43 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:43.588987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e4b3fe47-48fd-4f2d-beb3-2ef6e693a7e2 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a0ee940>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:43.705668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-e4b3fe47-48fd-4f2d-beb3-2ef6e693a7e2 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] HTTP exception thrown: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e4b3fe47-48fd-4f2d-beb3-2ef6e693a7e2 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Request method failure captured: Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 HTTP/1.1 Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC5965Qhb8oDsFjPOhM5kt2qz-sq2SnSHMmxuGAGg5JLkJT8Fk3JXqQeULP7mBG9LEwFHZI62PouE5EaXCBj1iAqwI2Hq7rdBH-judX0UiEer4XsRYj3G5iOe0SSofvLRXxdeSurJrACehWvUd3fvKeXWxgPZht93HMz2cyuOpH67xU Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 48a9b5852b69438eac339b063882d08c Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:34:43.709874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48a9b5852b69438eac339b063882d08c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48a9b5852b69438eac339b063882d08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48a9b5852b69438eac339b063882d08c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48a9b5852b69438eac339b063882d08c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 48a9b5852b69438eac339b063882d08c Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-VolumesSnapshotsTestJSON-1932656942-project Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 99687792e2714e4b8db1b6e699901dfe Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1932656942-project Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6'} Jun 17 07:34:43.711152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. (HTTP 404) (Request-ID: req-b6e41612-e2ab-4b51-a6f9-52dac749d098) Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.711920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:34:43.714126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 07:34:43.715166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.716184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e4b3fe47-48fd-4f2d-beb3-2ef6e693a7e2 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Returning 404 to user: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:43.731205 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e4b3fe47-48fd-4f2d-beb3-2ef6e693a7e2 tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6" status: 404 len: 109 microversion: 2.1 time: 0.138708 Jun 17 07:34:43.743031 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 21/45] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:34:43 2022] GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:34:43.744910 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-52dc2691-c388-4d0d-96be-c07842c1abd3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:43.746111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-52dc2691-c388-4d0d-96be-c07842c1abd3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:43.758916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52dc2691-c388-4d0d-96be-c07842c1abd3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:43.764934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a84aa759-c1eb-4a6b-9f1b-dc14909d220c tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06c522c10>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:43.770804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52dc2691-c388-4d0d-96be-c07842c1abd3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:43.771728 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52dc2691-c388-4d0d-96be-c07842c1abd3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:43.772328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52dc2691-c388-4d0d-96be-c07842c1abd3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:43.871605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-a84aa759-c1eb-4a6b-9f1b-dc14909d220c tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] HTTP exception thrown: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a84aa759-c1eb-4a6b-9f1b-dc14909d220c tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Request method failure captured: Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: DELETE /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 HTTP/1.1 Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC5965Qhb8oDsFjPOhM5kt2qz-sq2SnSHMmxuGAGg5JLkJT8Fk3JXqQeULP7mBG9LEwFHZI62PouE5EaXCBj1iAqwI2Hq7rdBH-judX0UiEer4XsRYj3G5iOe0SSofvLRXxdeSurJrACehWvUd3fvKeXWxgPZht93HMz2cyuOpH67xU Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 48a9b5852b69438eac339b063882d08c Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:34:43.873586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48a9b5852b69438eac339b063882d08c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48a9b5852b69438eac339b063882d08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48a9b5852b69438eac339b063882d08c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48a9b5852b69438eac339b063882d08c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 48a9b5852b69438eac339b063882d08c Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-VolumesSnapshotsTestJSON-1932656942-project Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 99687792e2714e4b8db1b6e699901dfe Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1932656942-project Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6'} Jun 17 07:34:43.875070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. (HTTP 404) (Request-ID: req-dd2bd7be-c3ec-4a33-ada7-5d520dd71490) Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.875773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:34:43.876679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 07:34:43.877626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a84aa759-c1eb-4a6b-9f1b-dc14909d220c tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Returning 404 to user: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a84aa759-c1eb-4a6b-9f1b-dc14909d220c tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6" status: 404 len: 109 microversion: 2.1 time: 0.131218 Jun 17 07:34:43.878526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 22/46] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:34:43 2022] DELETE /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:34:43.885568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-076206f4-0123-481d-850e-acb183297d2b tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Calling method '.version_select at 0x7fb06a0eeca0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:43.931327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-52dc2691-c388-4d0d-96be-c07842c1abd3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:43.940415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-52dc2691-c388-4d0d-96be-c07842c1abd3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1271 microversion: 2.1 time: 0.199717 Jun 17 07:34:43.946301 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 25/47] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:43 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:43.954966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-076206f4-0123-481d-850e-acb183297d2b tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] HTTP exception thrown: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-076206f4-0123-481d-850e-acb183297d2b tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Request method failure captured: Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 HTTP/1.1 Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC5965Qhb8oDsFjPOhM5kt2qz-sq2SnSHMmxuGAGg5JLkJT8Fk3JXqQeULP7mBG9LEwFHZI62PouE5EaXCBj1iAqwI2Hq7rdBH-judX0UiEer4XsRYj3G5iOe0SSofvLRXxdeSurJrACehWvUd3fvKeXWxgPZht93HMz2cyuOpH67xU Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 48a9b5852b69438eac339b063882d08c Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:34:43.956918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48a9b5852b69438eac339b063882d08c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48a9b5852b69438eac339b063882d08c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48a9b5852b69438eac339b063882d08c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48a9b5852b69438eac339b063882d08c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 48a9b5852b69438eac339b063882d08c Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1932656942 Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-VolumesSnapshotsTestJSON-1932656942-project Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 99687792e2714e4b8db1b6e699901dfe Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1932656942-project Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6'} Jun 17 07:34:43.963253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. (HTTP 404) (Request-ID: req-471e891a-5cb2-47cc-8d28-c40867a2f20c) Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.964207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:34:43.965250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 07:34:43.966276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-076206f4-0123-481d-850e-acb183297d2b tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] Returning 404 to user: Volume a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-076206f4-0123-481d-850e-acb183297d2b tempest-VolumesSnapshotsTestJSON-1932656942 tempest-VolumesSnapshotsTestJSON-1932656942-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6" status: 404 len: 109 microversion: 2.1 time: 0.076982 Jun 17 07:34:43.967764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 23/48] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:34:43 2022] GET /compute/v2.1/os-volumes/a77f61c9-12d5-45cd-9ab7-9f9155b2f7f6 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:34:44.442345 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-decb5b91-808c-40e1-9b8e-107cef88f4f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:44.443102 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-decb5b91-808c-40e1-9b8e-107cef88f4f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:44.454455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-decb5b91-808c-40e1-9b8e-107cef88f4f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:44.456495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-decb5b91-808c-40e1-9b8e-107cef88f4f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:44.457567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-decb5b91-808c-40e1-9b8e-107cef88f4f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:44.464375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-decb5b91-808c-40e1-9b8e-107cef88f4f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:44.616645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-593224015", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab57126c-dcfa-47e4-89e8-e968083b17b8"}], "security_groups": [{"name": "tempest-securitygroup--538292440"}], "key_name": "tempest-keypair-751308533", "user_data": "}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:34:44.803256 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-decb5b91-808c-40e1-9b8e-107cef88f4f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:44.815957 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-decb5b91-808c-40e1-9b8e-107cef88f4f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.378221 Jun 17 07:34:44.817024 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 26/49] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:44 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:44.959436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9ac8b0c5-13e8-4ffe-9def-917ab03814b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:44.960558 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9ac8b0c5-13e8-4ffe-9def-917ab03814b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:44.975289 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ac8b0c5-13e8-4ffe-9def-917ab03814b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:44.979603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ac8b0c5-13e8-4ffe-9def-917ab03814b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:44.983032 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ac8b0c5-13e8-4ffe-9def-917ab03814b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:44.984912 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ac8b0c5-13e8-4ffe-9def-917ab03814b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:45.089293 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] validate_networks() for [('ab57126c-dcfa-47e4-89e8-e968083b17b8', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:34:45.478885 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9ac8b0c5-13e8-4ffe-9def-917ab03814b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:45.488335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9ac8b0c5-13e8-4ffe-9def-917ab03814b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.533629 Jun 17 07:34:45.489695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 27/50] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:44 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:34:45.675359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:45.834355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fc544165-a24c-499c-ac1c-b09a08b0d0da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:45.835790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fc544165-a24c-499c-ac1c-b09a08b0d0da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:45.844498 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc544165-a24c-499c-ac1c-b09a08b0d0da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:45.845552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc544165-a24c-499c-ac1c-b09a08b0d0da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:45.846565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc544165-a24c-499c-ac1c-b09a08b0d0da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:45.847008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc544165-a24c-499c-ac1c-b09a08b0d0da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:45.893451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:34:45.893897 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:34:45.894540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:34:45.894948 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:34:45.895536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:34:45.905627 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:45.906072 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:45.906883 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:45.907312 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:45.925032 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Getting quotas for project 8432e3c517624c449606ca1201f2be12. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:34:45.929385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Getting quotas for user a3ea40ad7d7546449f60539341abc545 and project 8432e3c517624c449606ca1201f2be12. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:34:45.943541 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:34:45.946000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:34:46.057002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fc544165-a24c-499c-ac1c-b09a08b0d0da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:46.075586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fc544165-a24c-499c-ac1c-b09a08b0d0da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.244765 Jun 17 07:34:46.076736 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 28/51] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:45 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:46.137751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fc7fce8f-1758-4b13-8964-586871a3cc79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.526060 Jun 17 07:34:46.138407 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 24/52] 10.222.0.52 () {62 vars in 1187 bytes} [Fri Jun 17 07:34:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 07:34:46.148567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cc184001-20eb-401e-b671-3806b9ca1f5a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:46.149179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cc184001-20eb-401e-b671-3806b9ca1f5a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:46.203609 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cc184001-20eb-401e-b671-3806b9ca1f5a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:46.210920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cc184001-20eb-401e-b671-3806b9ca1f5a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:46.212977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cc184001-20eb-401e-b671-3806b9ca1f5a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:46.214132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cc184001-20eb-401e-b671-3806b9ca1f5a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1280 microversion: 2.20 time: 0.069576 Jun 17 07:34:46.214701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 29/53] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:46 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:46.505398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-21173eaa-ef02-4023-97c1-1bd90052580f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:46.506073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-21173eaa-ef02-4023-97c1-1bd90052580f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:46.514281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-21173eaa-ef02-4023-97c1-1bd90052580f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:46.514783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-21173eaa-ef02-4023-97c1-1bd90052580f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:46.515979 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-21173eaa-ef02-4023-97c1-1bd90052580f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:46.516679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-21173eaa-ef02-4023-97c1-1bd90052580f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:46.704341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-21173eaa-ef02-4023-97c1-1bd90052580f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:46.717996 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-21173eaa-ef02-4023-97c1-1bd90052580f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.216388 Jun 17 07:34:46.718586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 25/54] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:46 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:47.092484 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1914ec53-3197-47b7-a34a-59b3e48666e5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:47.092991 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1914ec53-3197-47b7-a34a-59b3e48666e5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:47.099334 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1914ec53-3197-47b7-a34a-59b3e48666e5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:47.099786 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1914ec53-3197-47b7-a34a-59b3e48666e5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:47.102478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1914ec53-3197-47b7-a34a-59b3e48666e5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:47.102478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1914ec53-3197-47b7-a34a-59b3e48666e5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:47.235202 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a0644364-c1bb-465f-8b31-f604e9a4a9bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:47.236176 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a0644364-c1bb-465f-8b31-f604e9a4a9bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:47.328529 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1914ec53-3197-47b7-a34a-59b3e48666e5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:47.329725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a0644364-c1bb-465f-8b31-f604e9a4a9bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:47.340271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1914ec53-3197-47b7-a34a-59b3e48666e5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.251713 Jun 17 07:34:47.342583 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 30/55] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:47 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:34:47.354568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a0644364-c1bb-465f-8b31-f604e9a4a9bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:47.354568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a0644364-c1bb-465f-8b31-f604e9a4a9bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:47.354568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a0644364-c1bb-465f-8b31-f604e9a4a9bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1280 microversion: 2.20 time: 0.116032 Jun 17 07:34:47.358968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 26/56] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:47 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1280 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:47.742820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f1fac936-076a-45bc-882d-bbabbd06635f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:47.744586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f1fac936-076a-45bc-882d-bbabbd06635f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:47.754257 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1fac936-076a-45bc-882d-bbabbd06635f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:47.758661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1fac936-076a-45bc-882d-bbabbd06635f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:47.758661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1fac936-076a-45bc-882d-bbabbd06635f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:47.758661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1fac936-076a-45bc-882d-bbabbd06635f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:47.973022 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f1fac936-076a-45bc-882d-bbabbd06635f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:47.981949 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f1fac936-076a-45bc-882d-bbabbd06635f tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.243986 Jun 17 07:34:47.983284 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 27/57] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:47 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:48.370224 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:48.370834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:48.371205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2d5c07a9-d288-48b4-a0f2-d416967cdf95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:48.371874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2d5c07a9-d288-48b4-a0f2-d416967cdf95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:48.375113 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=4 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:48.377295 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:48.377777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:48.378534 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:48.378968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:48.379325 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2d5c07a9-d288-48b4-a0f2-d416967cdf95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:48.379773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2d5c07a9-d288-48b4-a0f2-d416967cdf95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:48.380528 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2d5c07a9-d288-48b4-a0f2-d416967cdf95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:48.380960 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2d5c07a9-d288-48b4-a0f2-d416967cdf95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:48.444608 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:48.453976 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:48.455879 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:48.460110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6bb6bdc3-471a-437e-a2e8-715bcdb37822 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.091615 Jun 17 07:34:48.463275 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 28/58] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:48 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:48.530624 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2d5c07a9-d288-48b4-a0f2-d416967cdf95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:48.538183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2d5c07a9-d288-48b4-a0f2-d416967cdf95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.172563 Jun 17 07:34:48.538755 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 31/59] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:48 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:49.001079 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-03773a8d-5640-4871-82a2-5548203eb923 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:49.001878 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-03773a8d-5640-4871-82a2-5548203eb923 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:49.007795 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03773a8d-5640-4871-82a2-5548203eb923 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:49.011121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03773a8d-5640-4871-82a2-5548203eb923 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:49.011121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03773a8d-5640-4871-82a2-5548203eb923 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:49.011121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03773a8d-5640-4871-82a2-5548203eb923 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:49.208740 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-03773a8d-5640-4871-82a2-5548203eb923 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:49.220841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-03773a8d-5640-4871-82a2-5548203eb923 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.223319 Jun 17 07:34:49.223665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 29/60] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:48 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:49.483815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:49.484452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:49.492083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:49.492771 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:49.493958 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:49.494883 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:49.576566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dda5b120-aa65-429a-8938-912566b82f17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:49.577538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dda5b120-aa65-429a-8938-912566b82f17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:49.590810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dda5b120-aa65-429a-8938-912566b82f17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:49.593835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dda5b120-aa65-429a-8938-912566b82f17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:49.596488 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dda5b120-aa65-429a-8938-912566b82f17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:49.597280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dda5b120-aa65-429a-8938-912566b82f17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:49.603907 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:49.609179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:49.610933 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:49.612859 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ee5d4801-b6bd-4afd-939a-3820ba91ffed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.135195 Jun 17 07:34:49.613628 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 32/61] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:49 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:49.763906 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-dda5b120-aa65-429a-8938-912566b82f17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:49.772234 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dda5b120-aa65-429a-8938-912566b82f17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.210208 Jun 17 07:34:49.772809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 30/62] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:49 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:34:50.239467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fa2bfa8d-e2f0-4ee8-a090-e29237071f07 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:50.240081 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fa2bfa8d-e2f0-4ee8-a090-e29237071f07 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:50.257844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa8d-e2f0-4ee8-a090-e29237071f07 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:50.258309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa8d-e2f0-4ee8-a090-e29237071f07 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:50.259631 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa8d-e2f0-4ee8-a090-e29237071f07 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:50.260163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fa2bfa8d-e2f0-4ee8-a090-e29237071f07 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:50.416182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fa2bfa8d-e2f0-4ee8-a090-e29237071f07 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:50.427450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fa2bfa8d-e2f0-4ee8-a090-e29237071f07 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.191690 Jun 17 07:34:50.428135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 33/63] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:50 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:50.637845 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:50.637845 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:50.643468 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:50.644149 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:50.644984 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:50.645584 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:50.727533 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:50.736832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:50.738580 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:50.739952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ecb0286a-22eb-441b-b7b8-3f36a25678fe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.111573 Jun 17 07:34:50.740850 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 31/64] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:50 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:34:50.792601 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-17a3cfad-8b3c-4cf7-a962-3bce7bee1a40 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:50.792601 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-17a3cfad-8b3c-4cf7-a962-3bce7bee1a40 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:50.805124 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17a3cfad-8b3c-4cf7-a962-3bce7bee1a40 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:50.805675 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17a3cfad-8b3c-4cf7-a962-3bce7bee1a40 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:50.806988 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17a3cfad-8b3c-4cf7-a962-3bce7bee1a40 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:50.807438 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17a3cfad-8b3c-4cf7-a962-3bce7bee1a40 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:51.001692 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-17a3cfad-8b3c-4cf7-a962-3bce7bee1a40 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:51.010188 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-17a3cfad-8b3c-4cf7-a962-3bce7bee1a40 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.223899 Jun 17 07:34:51.011144 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 34/65] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:50 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:51.445011 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-56789f50-c717-4821-9f84-a0c8520b1725 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:51.445648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-56789f50-c717-4821-9f84-a0c8520b1725 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:51.452163 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-56789f50-c717-4821-9f84-a0c8520b1725 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:51.452603 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-56789f50-c717-4821-9f84-a0c8520b1725 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:51.453584 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-56789f50-c717-4821-9f84-a0c8520b1725 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:51.454019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-56789f50-c717-4821-9f84-a0c8520b1725 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:51.592489 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-56789f50-c717-4821-9f84-a0c8520b1725 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:51.600126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-56789f50-c717-4821-9f84-a0c8520b1725 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.158808 Jun 17 07:34:51.600700 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 32/66] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:51 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:51.762394 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:51.763115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:51.769601 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:51.774987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:51.774987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:51.774987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:51.853569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:51.861887 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:51.875131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:51.875131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8f7a8306-79ad-4e87-a559-ba959f9b4a99 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.117753 Jun 17 07:34:51.875131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 35/67] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:51 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:52.027299 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8e1880b2-54bb-470d-985d-9be17153b886 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:52.027911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8e1880b2-54bb-470d-985d-9be17153b886 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:52.038094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8e1880b2-54bb-470d-985d-9be17153b886 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:52.038094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8e1880b2-54bb-470d-985d-9be17153b886 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:52.038094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8e1880b2-54bb-470d-985d-9be17153b886 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:52.038094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8e1880b2-54bb-470d-985d-9be17153b886 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:52.190869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8e1880b2-54bb-470d-985d-9be17153b886 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:52.198811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8e1880b2-54bb-470d-985d-9be17153b886 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.175461 Jun 17 07:34:52.199778 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 33/68] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:52 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:52.617189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-47fd82e1-92da-4846-849b-2433ce99bb2a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:52.618186 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-47fd82e1-92da-4846-849b-2433ce99bb2a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:52.626680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-47fd82e1-92da-4846-849b-2433ce99bb2a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:52.628393 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-47fd82e1-92da-4846-849b-2433ce99bb2a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:52.629464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-47fd82e1-92da-4846-849b-2433ce99bb2a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:52.630140 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-47fd82e1-92da-4846-849b-2433ce99bb2a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:52.785150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-47fd82e1-92da-4846-849b-2433ce99bb2a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:52.789441 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-47fd82e1-92da-4846-849b-2433ce99bb2a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.176157 Jun 17 07:34:52.796008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 36/69] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:52 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:52.895952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:52.896560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:52.902711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:52.903161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:52.903907 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:52.904334 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:52.965358 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:52.973678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:52.975230 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:52.976520 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7af2203a-058e-41de-8c87-8301161b5917 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.084576 Jun 17 07:34:52.977086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 34/70] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:52 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:53.216440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-96f307a8-9a65-4c35-a6a4-4d79670e1160 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:53.217176 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-96f307a8-9a65-4c35-a6a4-4d79670e1160 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:53.223978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96f307a8-9a65-4c35-a6a4-4d79670e1160 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:53.224218 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96f307a8-9a65-4c35-a6a4-4d79670e1160 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:53.224981 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96f307a8-9a65-4c35-a6a4-4d79670e1160 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:53.225437 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96f307a8-9a65-4c35-a6a4-4d79670e1160 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:53.373611 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-96f307a8-9a65-4c35-a6a4-4d79670e1160 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:53.377365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:53.381860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-96f307a8-9a65-4c35-a6a4-4d79670e1160 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.169720 Jun 17 07:34:53.382508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 37/71] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:53 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:53.807784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5a20f4b6-1507-40a9-b645-70949acfece3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:53.808498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5a20f4b6-1507-40a9-b645-70949acfece3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:53.815077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a20f4b6-1507-40a9-b645-70949acfece3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:53.819453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a20f4b6-1507-40a9-b645-70949acfece3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:53.819453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a20f4b6-1507-40a9-b645-70949acfece3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:53.819453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a20f4b6-1507-40a9-b645-70949acfece3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:53.961648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5a20f4b6-1507-40a9-b645-70949acfece3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:53.970185 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5a20f4b6-1507-40a9-b645-70949acfece3 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.166890 Jun 17 07:34:53.974395 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 35/72] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:53 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:53.997359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:53.998129 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:54.005113 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:54.005792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:54.006638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:54.007299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:54.070808 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:54.079794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:54.081501 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:54.082641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0bfb19d5-a8f9-4e2c-a449-a9af0adef25a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.091269 Jun 17 07:34:54.094466 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 38/73] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:53 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:54.400333 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d8be8e90-7de1-4a47-bb2f-23ca1fa23ac8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:54.401232 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d8be8e90-7de1-4a47-bb2f-23ca1fa23ac8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:54.417776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8be8e90-7de1-4a47-bb2f-23ca1fa23ac8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:54.418225 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8be8e90-7de1-4a47-bb2f-23ca1fa23ac8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:54.418987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8be8e90-7de1-4a47-bb2f-23ca1fa23ac8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:54.419422 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8be8e90-7de1-4a47-bb2f-23ca1fa23ac8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:54.589465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d8be8e90-7de1-4a47-bb2f-23ca1fa23ac8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:54.597218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d8be8e90-7de1-4a47-bb2f-23ca1fa23ac8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.201261 Jun 17 07:34:54.598283 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 36/74] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:54 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:54.991857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1e4f3c46-377a-4145-983b-bb00913791ea tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:54.993806 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1e4f3c46-377a-4145-983b-bb00913791ea tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:55.006520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1e4f3c46-377a-4145-983b-bb00913791ea tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:55.006520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1e4f3c46-377a-4145-983b-bb00913791ea tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:55.006520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1e4f3c46-377a-4145-983b-bb00913791ea tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:55.006520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1e4f3c46-377a-4145-983b-bb00913791ea tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:55.103686 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:55.104787 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:55.116291 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:55.118895 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:55.121310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:55.122827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:55.250222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:55.259699 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:55.261579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:55.262847 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d9361a26-36b4-4705-be0d-983b2b795608 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.164367 Jun 17 07:34:55.265007 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1e4f3c46-377a-4145-983b-bb00913791ea tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:55.274456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 37/75] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:55 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:34:55.282701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1e4f3c46-377a-4145-983b-bb00913791ea tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.296044 Jun 17 07:34:55.283994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:54 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:55.618174 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3a920d54-fafd-4050-b8c5-391b996ce258 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:55.618810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3a920d54-fafd-4050-b8c5-391b996ce258 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:55.627329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a920d54-fafd-4050-b8c5-391b996ce258 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:55.627932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a920d54-fafd-4050-b8c5-391b996ce258 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:55.628585 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a920d54-fafd-4050-b8c5-391b996ce258 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:55.629024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a920d54-fafd-4050-b8c5-391b996ce258 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:55.843695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3a920d54-fafd-4050-b8c5-391b996ce258 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:55.846321 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3a920d54-fafd-4050-b8c5-391b996ce258 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.235377 Jun 17 07:34:55.847005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 38/77] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:55 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:56.282324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:56.283634 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:56.286099 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=20 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:56.292332 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:56.292793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:56.293618 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:56.309450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:56.330068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-91fc3f5d-9b89-4a74-bec2-57e093316572 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:56.330068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-91fc3f5d-9b89-4a74-bec2-57e093316572 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:56.348576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91fc3f5d-9b89-4a74-bec2-57e093316572 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:56.367670 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91fc3f5d-9b89-4a74-bec2-57e093316572 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:56.369005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91fc3f5d-9b89-4a74-bec2-57e093316572 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:56.370006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91fc3f5d-9b89-4a74-bec2-57e093316572 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:56.389764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:56.398993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:56.406649 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:56.407820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e391f90f-6eb4-49a4-b539-6c68d43bdcbe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.130271 Jun 17 07:34:56.408598 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 40/78] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:56 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:56.514356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:56.612454 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-91fc3f5d-9b89-4a74-bec2-57e093316572 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:56.616017 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:56.621602 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-91fc3f5d-9b89-4a74-bec2-57e093316572 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.314347 Jun 17 07:34:56.622803 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 39/79] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:56 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:34:56.864669 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-825ef516-a129-49bb-aaca-76a7f793aa66 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:56.865386 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-825ef516-a129-49bb-aaca-76a7f793aa66 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:56.889717 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-825ef516-a129-49bb-aaca-76a7f793aa66 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:56.892454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-825ef516-a129-49bb-aaca-76a7f793aa66 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:56.894025 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-825ef516-a129-49bb-aaca-76a7f793aa66 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:56.900770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-825ef516-a129-49bb-aaca-76a7f793aa66 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:57.156722 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-825ef516-a129-49bb-aaca-76a7f793aa66 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:57.187416 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-825ef516-a129-49bb-aaca-76a7f793aa66 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.327617 Jun 17 07:34:57.193476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 41/80] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:56 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:57.433316 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:57.433316 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:57.433316 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=24 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:57.445012 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:57.445715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:57.447771 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:57.448841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:57.550375 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:57.572993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:57.579214 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:57.580360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2c4bf520-a583-4920-9585-4d679a7acad5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.157554 Jun 17 07:34:57.581997 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 40/81] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:57 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:34:57.639425 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-28d0f487-6dea-437e-a056-4a880b1b40a7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:57.650932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-28d0f487-6dea-437e-a056-4a880b1b40a7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:57.650932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-28d0f487-6dea-437e-a056-4a880b1b40a7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:57.650932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-28d0f487-6dea-437e-a056-4a880b1b40a7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:57.650932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-28d0f487-6dea-437e-a056-4a880b1b40a7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:57.651496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-28d0f487-6dea-437e-a056-4a880b1b40a7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:57.835520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-28d0f487-6dea-437e-a056-4a880b1b40a7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:57.844382 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-28d0f487-6dea-437e-a056-4a880b1b40a7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.209238 Jun 17 07:34:57.854753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 42/82] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:57 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:58.209656 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4d60f494-439b-4d68-a9fe-c75a5053cbfd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:58.209656 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4d60f494-439b-4d68-a9fe-c75a5053cbfd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:58.212490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4d60f494-439b-4d68-a9fe-c75a5053cbfd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:58.212944 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4d60f494-439b-4d68-a9fe-c75a5053cbfd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:58.213735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4d60f494-439b-4d68-a9fe-c75a5053cbfd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:58.214438 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4d60f494-439b-4d68-a9fe-c75a5053cbfd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:58.421621 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4d60f494-439b-4d68-a9fe-c75a5053cbfd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:58.433968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4d60f494-439b-4d68-a9fe-c75a5053cbfd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.232215 Jun 17 07:34:58.448803 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 41/83] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:58 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:58.599544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:58.600362 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:58.609124 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:58.609637 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:58.610415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:58.610850 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:58.696224 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:58.703987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:58.706868 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:58.708216 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d1898471-dfc6-4af4-879c-fb8ffa61f687 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.112998 Jun 17 07:34:58.709666 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 43/84] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:58 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:34:58.861980 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c4b1a366-a7f9-4f7f-b35e-96fa1d470338 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:58.862680 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c4b1a366-a7f9-4f7f-b35e-96fa1d470338 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:58.865632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:34:58.869839 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4b1a366-a7f9-4f7f-b35e-96fa1d470338 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:58.873791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4b1a366-a7f9-4f7f-b35e-96fa1d470338 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:58.873791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4b1a366-a7f9-4f7f-b35e-96fa1d470338 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:58.873791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4b1a366-a7f9-4f7f-b35e-96fa1d470338 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:59.015887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c4b1a366-a7f9-4f7f-b35e-96fa1d470338 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:59.024015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c4b1a366-a7f9-4f7f-b35e-96fa1d470338 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.165876 Jun 17 07:34:59.025369 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 42/85] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:58 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:59.462951 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6e6f2170-b5b5-4ad0-97b5-c9f883eda80b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:59.463818 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6e6f2170-b5b5-4ad0-97b5-c9f883eda80b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:59.470564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6e6f2170-b5b5-4ad0-97b5-c9f883eda80b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:59.471094 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6e6f2170-b5b5-4ad0-97b5-c9f883eda80b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:59.471758 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6e6f2170-b5b5-4ad0-97b5-c9f883eda80b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:59.472190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6e6f2170-b5b5-4ad0-97b5-c9f883eda80b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:59.622811 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6e6f2170-b5b5-4ad0-97b5-c9f883eda80b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:59.631896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6e6f2170-b5b5-4ad0-97b5-c9f883eda80b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.173291 Jun 17 07:34:59.632678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 44/86] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:34:59 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:34:59.730384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:34:59.730997 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:34:59.736902 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:59.737366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:59.738125 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:34:59.738560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:34:59.801020 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:59.810473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:59.812013 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:34:59.813201 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-89f7677f-e39a-4440-bf78-df031b7c2129 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.090171 Jun 17 07:34:59.814221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 43/87] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:34:59 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:00.049857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6cf0b5b6-b962-4f3d-8a9a-631e1c69f057 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:00.050443 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6cf0b5b6-b962-4f3d-8a9a-631e1c69f057 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:00.057292 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6cf0b5b6-b962-4f3d-8a9a-631e1c69f057 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:00.063135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6cf0b5b6-b962-4f3d-8a9a-631e1c69f057 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:00.063135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6cf0b5b6-b962-4f3d-8a9a-631e1c69f057 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:00.063135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6cf0b5b6-b962-4f3d-8a9a-631e1c69f057 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:00.197776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6cf0b5b6-b962-4f3d-8a9a-631e1c69f057 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:00.204858 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6cf0b5b6-b962-4f3d-8a9a-631e1c69f057 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.158753 Jun 17 07:35:00.205468 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 45/88] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:00 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:00.649144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-76ef0b4d-d696-4551-9aeb-3737902bad57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:00.650564 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-76ef0b4d-d696-4551-9aeb-3737902bad57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:00.657277 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-76ef0b4d-d696-4551-9aeb-3737902bad57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:00.662352 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-76ef0b4d-d696-4551-9aeb-3737902bad57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:00.662352 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-76ef0b4d-d696-4551-9aeb-3737902bad57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:00.662352 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-76ef0b4d-d696-4551-9aeb-3737902bad57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:00.809658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-76ef0b4d-d696-4551-9aeb-3737902bad57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:00.817587 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-76ef0b4d-d696-4551-9aeb-3737902bad57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.172613 Jun 17 07:35:00.818268 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 44/89] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:00 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:00.832062 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:00.832670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:00.838869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:00.839316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:00.840080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:00.840518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:00.909271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:00.918337 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:00.919917 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:00.920971 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9a116259-7a00-4b97-a69b-f28bc4473f79 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.092909 Jun 17 07:35:00.921549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 46/90] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:00 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:01.223035 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dd9294b6-abce-46e2-ba8b-765a4e24d109 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:01.226543 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dd9294b6-abce-46e2-ba8b-765a4e24d109 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:01.231111 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dd9294b6-abce-46e2-ba8b-765a4e24d109 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:01.231768 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dd9294b6-abce-46e2-ba8b-765a4e24d109 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:01.232531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dd9294b6-abce-46e2-ba8b-765a4e24d109 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:01.233140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dd9294b6-abce-46e2-ba8b-765a4e24d109 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:01.375156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-dd9294b6-abce-46e2-ba8b-765a4e24d109 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:01.384551 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dd9294b6-abce-46e2-ba8b-765a4e24d109 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.165252 Jun 17 07:35:01.385348 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 45/91] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:01 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:01.835042 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-60fe3c28-a47a-4c6f-b822-bc74c809ef9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:01.835653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-60fe3c28-a47a-4c6f-b822-bc74c809ef9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:01.838642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:01.847904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-60fe3c28-a47a-4c6f-b822-bc74c809ef9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:01.847904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-60fe3c28-a47a-4c6f-b822-bc74c809ef9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:01.847904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-60fe3c28-a47a-4c6f-b822-bc74c809ef9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:01.847904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-60fe3c28-a47a-4c6f-b822-bc74c809ef9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:01.940243 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:01.941520 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:01.950939 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:01.951748 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:01.952581 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:01.953075 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:01.979051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-60fe3c28-a47a-4c6f-b822-bc74c809ef9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:01.987024 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-60fe3c28-a47a-4c6f-b822-bc74c809ef9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.155720 Jun 17 07:35:01.996853 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 47/92] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:01 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:02.018663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:02.031453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:02.032739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:02.034035 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a000e6ff-5e37-4b8c-ad89-4b3ab9d104c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.098298 Jun 17 07:35:02.046619 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 46/93] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:01 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:02.403612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8e409e7f-0073-4b78-b2c1-8c8a910f523c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:02.404230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8e409e7f-0073-4b78-b2c1-8c8a910f523c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:02.410781 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8e409e7f-0073-4b78-b2c1-8c8a910f523c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:02.411228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8e409e7f-0073-4b78-b2c1-8c8a910f523c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:02.411994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8e409e7f-0073-4b78-b2c1-8c8a910f523c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:02.412432 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8e409e7f-0073-4b78-b2c1-8c8a910f523c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:02.545182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8e409e7f-0073-4b78-b2c1-8c8a910f523c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:02.553070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8e409e7f-0073-4b78-b2c1-8c8a910f523c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.154493 Jun 17 07:35:02.553842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 48/94] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:02 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:03.004461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-74f12ade-58d6-4893-990b-85e142673f8d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:03.005119 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-74f12ade-58d6-4893-990b-85e142673f8d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:03.012293 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-74f12ade-58d6-4893-990b-85e142673f8d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:03.012736 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-74f12ade-58d6-4893-990b-85e142673f8d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:03.013706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-74f12ade-58d6-4893-990b-85e142673f8d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:03.014298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-74f12ade-58d6-4893-990b-85e142673f8d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:03.053721 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:03.054424 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:03.061248 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:03.061807 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:03.062574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:03.063009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:03.146046 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:03.155216 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:03.156770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:03.157903 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ad9f1dc5-37e4-4f36-af7f-ffea94e9b900 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1284 microversion: 2.20 time: 0.108183 Jun 17 07:35:03.158018 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-74f12ade-58d6-4893-990b-85e142673f8d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:03.158527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 49/95] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:03 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:35:03.165739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-74f12ade-58d6-4893-990b-85e142673f8d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.165164 Jun 17 07:35:03.166309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 47/96] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:02 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:03.571820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9169ae40-2970-4047-9bee-fc74ca5b1799 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:03.572422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9169ae40-2970-4047-9bee-fc74ca5b1799 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:03.578898 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9169ae40-2970-4047-9bee-fc74ca5b1799 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:03.583742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9169ae40-2970-4047-9bee-fc74ca5b1799 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:03.583742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9169ae40-2970-4047-9bee-fc74ca5b1799 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:03.583742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9169ae40-2970-4047-9bee-fc74ca5b1799 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:03.819304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9169ae40-2970-4047-9bee-fc74ca5b1799 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:03.829962 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9169ae40-2970-4047-9bee-fc74ca5b1799 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.262794 Jun 17 07:35:03.843735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 50/97] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:03 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:04.178019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:04.180619 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:04.182993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0c1db4c4-65a3-48ea-b4ee-3e3243ceb0db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:04.183608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0c1db4c4-65a3-48ea-b4ee-3e3243ceb0db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:04.187583 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:04.188097 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:04.188930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:04.189457 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:04.198741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c1db4c4-65a3-48ea-b4ee-3e3243ceb0db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:04.199186 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c1db4c4-65a3-48ea-b4ee-3e3243ceb0db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:04.200497 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c1db4c4-65a3-48ea-b4ee-3e3243ceb0db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:04.201180 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c1db4c4-65a3-48ea-b4ee-3e3243ceb0db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:04.274582 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:04.290555 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:04.290555 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:04.290555 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b49e69b2-2418-41eb-9722-275f701e17f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1276 microversion: 2.20 time: 0.115732 Jun 17 07:35:04.290944 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 48/98] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:04 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:04.493902 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0c1db4c4-65a3-48ea-b4ee-3e3243ceb0db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:04.505850 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0c1db4c4-65a3-48ea-b4ee-3e3243ceb0db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.327121 Jun 17 07:35:04.506778 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 51/99] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:04 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:04.853499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d8bb211d-07d5-4c78-8cff-068c9d013305 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:04.856006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d8bb211d-07d5-4c78-8cff-068c9d013305 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:04.880169 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8bb211d-07d5-4c78-8cff-068c9d013305 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:04.885552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8bb211d-07d5-4c78-8cff-068c9d013305 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:04.896369 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8bb211d-07d5-4c78-8cff-068c9d013305 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:04.897926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8bb211d-07d5-4c78-8cff-068c9d013305 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:05.278541 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-2bce3e4b-eca6-4b70-99b0-6a1f845a56fc req-17957def-cb55-4841-806f-9e18722811fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e997afb-9a72-40c0-8b38-871954558286", "tag": "5366877e-faf9-4498-943a-cff8f23c175e"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:05.303898 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-2bce3e4b-eca6-4b70-99b0-6a1f845a56fc req-17957def-cb55-4841-806f-9e18722811fc service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:05.305653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-2bce3e4b-eca6-4b70-99b0-6a1f845a56fc req-17957def-cb55-4841-806f-9e18722811fc service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:05.342595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-2bce3e4b-eca6-4b70-99b0-6a1f845a56fc req-17957def-cb55-4841-806f-9e18722811fc service nova] Creating event network-changed:5366877e-faf9-4498-943a-cff8f23c175e for instance 4e997afb-9a72-40c0-8b38-871954558286 on hv-cinder-79733 Jun 17 07:35:05.343360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-2bce3e4b-eca6-4b70-99b0-6a1f845a56fc req-17957def-cb55-4841-806f-9e18722811fc service nova] Acquired lock "compute-rpcapi-router" {{(pid=124472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 07:35:05.345037 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3407eb31-9143-4e54-b077-a4a155c96615 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:05.345803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3407eb31-9143-4e54-b077-a4a155c96615 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:05.351142 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3407eb31-9143-4e54-b077-a4a155c96615 None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:05.358002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3407eb31-9143-4e54-b077-a4a155c96615 None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:05.372658 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.compute.rpcapi [None req-3407eb31-9143-4e54-b077-a4a155c96615 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 07:35:05.374096 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3407eb31-9143-4e54-b077-a4a155c96615 None None] Releasing lock "compute-rpcapi-router" {{(pid=124472) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 07:35:05.408363 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3407eb31-9143-4e54-b077-a4a155c96615 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257893 Jun 17 07:35:05.408911 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 52/100] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:35:05.414830 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:05.415689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:05.427342 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:05.428045 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:05.429170 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:05.429900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:06.002632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d8bb211d-07d5-4c78-8cff-068c9d013305 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:06.002632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d8bb211d-07d5-4c78-8cff-068c9d013305 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 1.005968 Jun 17 07:35:06.002632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 49/101] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:04 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:06.002632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7776deb5-762d-493b-8556-898aee414cac tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:06.005309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7776deb5-762d-493b-8556-898aee414cac tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:06.005309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7776deb5-762d-493b-8556-898aee414cac tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:06.005309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7776deb5-762d-493b-8556-898aee414cac tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:06.005309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7776deb5-762d-493b-8556-898aee414cac tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:06.007044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7776deb5-762d-493b-8556-898aee414cac tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:06.111445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:06.126644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:06.129105 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:06.137095 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ff06ccbc-9649-4a8b-8d33-f24ac12b1dba tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1340 microversion: 2.20 time: 0.722455 Jun 17 07:35:06.138104 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 53/102] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:05 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1340 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:06.241532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-2be372a7-9953-41d3-8d03-d7d231429472 req-b0e86220-c151-4faf-882c-b54a0e6dbc1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "890073f7-7e31-4a66-85bf-99292054e64f", "tag": "20c496e9-41d6-48b1-8faf-5a524259d80b"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:06.254063 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-2be372a7-9953-41d3-8d03-d7d231429472 req-b0e86220-c151-4faf-882c-b54a0e6dbc1a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:06.254426 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-2be372a7-9953-41d3-8d03-d7d231429472 req-b0e86220-c151-4faf-882c-b54a0e6dbc1a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:06.269266 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-2be372a7-9953-41d3-8d03-d7d231429472 req-b0e86220-c151-4faf-882c-b54a0e6dbc1a service nova] Creating event network-changed:20c496e9-41d6-48b1-8faf-5a524259d80b for instance 890073f7-7e31-4a66-85bf-99292054e64f on hv-cinder-79733 Jun 17 07:35:06.283521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-2be372a7-9953-41d3-8d03-d7d231429472 req-b0e86220-c151-4faf-882c-b54a0e6dbc1a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143212 Jun 17 07:35:06.284373 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 54/103] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:35:06.331594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7776deb5-762d-493b-8556-898aee414cac tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:06.340076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7776deb5-762d-493b-8556-898aee414cac tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.484645 Jun 17 07:35:06.340660 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 50/104] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:05 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:06.871437 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e1287503-9650-40ee-b444-3b5496e430ce tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:06.872995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e1287503-9650-40ee-b444-3b5496e430ce tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:06.879781 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e1287503-9650-40ee-b444-3b5496e430ce tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:06.880429 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e1287503-9650-40ee-b444-3b5496e430ce tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:06.881357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e1287503-9650-40ee-b444-3b5496e430ce tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:06.881792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e1287503-9650-40ee-b444-3b5496e430ce tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:06.903139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:07.110015 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e1287503-9650-40ee-b444-3b5496e430ce tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:07.118115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e1287503-9650-40ee-b444-3b5496e430ce tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.250516 Jun 17 07:35:07.118741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 55/105] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:06 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:07.159365 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:07.160534 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:07.169945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:07.170666 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:07.171862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:07.172467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:07.238443 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:07.247124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:07.248613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:07.250017 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cd8b81bc-feb3-4427-9c39-c67910ef5ab0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1338 microversion: 2.20 time: 0.098036 Jun 17 07:35:07.250578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 51/106] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:07 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:07.358750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1f6e738b-fda1-4135-908e-6914539d5870 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:07.359542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1f6e738b-fda1-4135-908e-6914539d5870 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:07.365890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6e738b-fda1-4135-908e-6914539d5870 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:07.366337 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6e738b-fda1-4135-908e-6914539d5870 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:07.367100 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6e738b-fda1-4135-908e-6914539d5870 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:07.367555 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6e738b-fda1-4135-908e-6914539d5870 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:07.515651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1f6e738b-fda1-4135-908e-6914539d5870 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:07.525763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1f6e738b-fda1-4135-908e-6914539d5870 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.169004 Jun 17 07:35:07.525763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 56/107] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:07 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:08.138070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6b29178b-2a2c-4748-b9a3-4b437ef1daee tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:08.138070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6b29178b-2a2c-4748-b9a3-4b437ef1daee tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:08.144378 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6b29178b-2a2c-4748-b9a3-4b437ef1daee tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.144910 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6b29178b-2a2c-4748-b9a3-4b437ef1daee tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.145810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6b29178b-2a2c-4748-b9a3-4b437ef1daee tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.147530 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6b29178b-2a2c-4748-b9a3-4b437ef1daee tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.269517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:08.270072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:08.276984 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.277518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.278477 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.278942 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.288350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6b29178b-2a2c-4748-b9a3-4b437ef1daee tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:08.298296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6b29178b-2a2c-4748-b9a3-4b437ef1daee tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.166181 Jun 17 07:35:08.299550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 52/108] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:08 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:08.313616 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-a55466fd-71c8-4797-8675-58b149cfe89e req-86cf3eb4-7bb4-44e1-828a-17ce4226b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5abf359-6883-489c-b6bc-d6456efc857d", "tag": "d8ca212b-ae6d-40b5-8948-4d106f1e7165"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:08.330892 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-a55466fd-71c8-4797-8675-58b149cfe89e req-86cf3eb4-7bb4-44e1-828a-17ce4226b1ab service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.338742 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-a55466fd-71c8-4797-8675-58b149cfe89e req-86cf3eb4-7bb4-44e1-828a-17ce4226b1ab service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.354475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-a55466fd-71c8-4797-8675-58b149cfe89e req-86cf3eb4-7bb4-44e1-828a-17ce4226b1ab service nova] Creating event network-changed:d8ca212b-ae6d-40b5-8948-4d106f1e7165 for instance e5abf359-6883-489c-b6bc-d6456efc857d on hv-cinder-79733 Jun 17 07:35:08.355001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-a55466fd-71c8-4797-8675-58b149cfe89e req-86cf3eb4-7bb4-44e1-828a-17ce4226b1ab service nova] Acquired lock "compute-rpcapi-router" {{(pid=124471) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 07:35:08.356093 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6fba9cd1-e6b7-427b-bfa5-426f53b18221 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.356639 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6fba9cd1-e6b7-427b-bfa5-426f53b18221 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.357934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6fba9cd1-e6b7-427b-bfa5-426f53b18221 None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.358358 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6fba9cd1-e6b7-427b-bfa5-426f53b18221 None None] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.369217 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.compute.rpcapi [None req-6fba9cd1-e6b7-427b-bfa5-426f53b18221 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 07:35:08.371369 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6fba9cd1-e6b7-427b-bfa5-426f53b18221 None None] Releasing lock "compute-rpcapi-router" {{(pid=124471) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 07:35:08.391051 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6fba9cd1-e6b7-427b-bfa5-426f53b18221 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088542 Jun 17 07:35:08.395119 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 53/109] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:35:08.468512 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:08.478069 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:08.479928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:08.481352 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-153174f1-f899-4a93-9fa7-55e8e8ec524c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.216161 Jun 17 07:35:08.486663 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 57/110] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:08 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:08.541497 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a89dcd08-40f7-4611-a4f7-8beb6209d3b4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:08.542273 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a89dcd08-40f7-4611-a4f7-8beb6209d3b4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:08.548610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a89dcd08-40f7-4611-a4f7-8beb6209d3b4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.549049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a89dcd08-40f7-4611-a4f7-8beb6209d3b4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.549887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a89dcd08-40f7-4611-a4f7-8beb6209d3b4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:08.550337 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a89dcd08-40f7-4611-a4f7-8beb6209d3b4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:08.687962 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a89dcd08-40f7-4611-a4f7-8beb6209d3b4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:08.695329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a89dcd08-40f7-4611-a4f7-8beb6209d3b4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.158817 Jun 17 07:35:08.696828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 54/111] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:08 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:09.320152 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-08ff35ba-4b95-4acd-bb7f-015b657564d2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:09.321302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-08ff35ba-4b95-4acd-bb7f-015b657564d2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:09.327360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-08ff35ba-4b95-4acd-bb7f-015b657564d2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:09.327801 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-08ff35ba-4b95-4acd-bb7f-015b657564d2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:09.328557 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-08ff35ba-4b95-4acd-bb7f-015b657564d2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:09.328981 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-08ff35ba-4b95-4acd-bb7f-015b657564d2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:09.500651 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:09.501410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:09.507536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:09.508577 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:09.509564 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:09.510251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:09.547169 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-08ff35ba-4b95-4acd-bb7f-015b657564d2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:09.559268 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-08ff35ba-4b95-4acd-bb7f-015b657564d2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.242908 Jun 17 07:35:09.564428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 58/112] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:09 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:09.656685 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:09.665741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:09.667258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:09.668396 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-14e1edb1-bb87-4aa8-ad85-324b20d351c6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.172084 Jun 17 07:35:09.668962 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 55/113] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:09 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:35:09.714145 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c3b36f6b-5f5c-4717-84af-f88184397bf5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:09.714887 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c3b36f6b-5f5c-4717-84af-f88184397bf5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:09.721427 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c3b36f6b-5f5c-4717-84af-f88184397bf5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:09.722242 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c3b36f6b-5f5c-4717-84af-f88184397bf5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:09.723233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c3b36f6b-5f5c-4717-84af-f88184397bf5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:09.723829 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c3b36f6b-5f5c-4717-84af-f88184397bf5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:09.885780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c3b36f6b-5f5c-4717-84af-f88184397bf5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:09.896339 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c3b36f6b-5f5c-4717-84af-f88184397bf5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.186829 Jun 17 07:35:09.897119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 59/114] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:09 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:10.581661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b39a6de8-4054-4854-90a2-8131bf47c2aa tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:10.582317 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b39a6de8-4054-4854-90a2-8131bf47c2aa tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:10.588854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b39a6de8-4054-4854-90a2-8131bf47c2aa tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:10.589304 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b39a6de8-4054-4854-90a2-8131bf47c2aa tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:10.590096 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b39a6de8-4054-4854-90a2-8131bf47c2aa tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:10.590531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b39a6de8-4054-4854-90a2-8131bf47c2aa tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:10.689092 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:10.689816 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:10.701928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:10.701928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:10.701928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:10.701928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:10.767628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b39a6de8-4054-4854-90a2-8131bf47c2aa tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:10.771653 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:10.777418 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b39a6de8-4054-4854-90a2-8131bf47c2aa tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.199753 Jun 17 07:35:10.778218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 56/115] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:10 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:10.893574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:10.903310 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:10.905082 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:10.906257 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b63f084f-a4d1-4d5d-9880-efc2ab07cd8d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.223345 Jun 17 07:35:10.913460 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 60/116] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:10 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:10.914292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d022f6c5-4633-4931-bf41-c3b5958635dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:10.915057 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d022f6c5-4633-4931-bf41-c3b5958635dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:10.921344 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d022f6c5-4633-4931-bf41-c3b5958635dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:10.921802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d022f6c5-4633-4931-bf41-c3b5958635dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:10.922568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d022f6c5-4633-4931-bf41-c3b5958635dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:10.923002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d022f6c5-4633-4931-bf41-c3b5958635dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:11.091355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d022f6c5-4633-4931-bf41-c3b5958635dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:11.099544 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d022f6c5-4633-4931-bf41-c3b5958635dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.189222 Jun 17 07:35:11.110571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 57/117] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:10 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:11.794798 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0fe52611-2351-49ab-8c8d-e961f74c935d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:11.795489 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0fe52611-2351-49ab-8c8d-e961f74c935d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:11.801543 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0fe52611-2351-49ab-8c8d-e961f74c935d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:11.801987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0fe52611-2351-49ab-8c8d-e961f74c935d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:11.802741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0fe52611-2351-49ab-8c8d-e961f74c935d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:11.803173 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0fe52611-2351-49ab-8c8d-e961f74c935d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:11.929758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:11.931500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:11.940751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:11.940751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:11.940751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:11.940751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:11.965347 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0fe52611-2351-49ab-8c8d-e961f74c935d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:11.973665 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0fe52611-2351-49ab-8c8d-e961f74c935d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.182781 Jun 17 07:35:11.974377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 61/118] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:11 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:12.088041 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:12.097593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:12.099127 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:12.100304 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-93be62be-1581-45a2-b8e0-211b4f7152a5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.175094 Jun 17 07:35:12.100866 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 58/119] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:11 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:35:12.118258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-586342db-ca56-429c-ae8c-8c23ebeca69d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:12.118937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-586342db-ca56-429c-ae8c-8c23ebeca69d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:12.125596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-586342db-ca56-429c-ae8c-8c23ebeca69d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:12.126044 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-586342db-ca56-429c-ae8c-8c23ebeca69d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:12.126803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-586342db-ca56-429c-ae8c-8c23ebeca69d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:12.127237 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-586342db-ca56-429c-ae8c-8c23ebeca69d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:12.267099 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-586342db-ca56-429c-ae8c-8c23ebeca69d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:12.276791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-586342db-ca56-429c-ae8c-8c23ebeca69d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.161969 Jun 17 07:35:12.278348 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 62/120] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:12 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:12.991958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-266d23a0-2f48-4e3c-aa09-c6eac318861a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:12.994616 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-266d23a0-2f48-4e3c-aa09-c6eac318861a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:13.001511 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-266d23a0-2f48-4e3c-aa09-c6eac318861a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:13.002202 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-266d23a0-2f48-4e3c-aa09-c6eac318861a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:13.003192 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-266d23a0-2f48-4e3c-aa09-c6eac318861a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:13.003910 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-266d23a0-2f48-4e3c-aa09-c6eac318861a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:13.119634 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:13.125443 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:13.128199 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:13.128657 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:13.129500 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:13.129938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:13.199692 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-266d23a0-2f48-4e3c-aa09-c6eac318861a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:13.211838 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-266d23a0-2f48-4e3c-aa09-c6eac318861a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.223352 Jun 17 07:35:13.213030 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 59/121] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:12 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:13.294462 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b119a4e8-12b1-42ea-9520-719a7d416662 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:13.295158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b119a4e8-12b1-42ea-9520-719a7d416662 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:13.301595 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b119a4e8-12b1-42ea-9520-719a7d416662 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:13.302151 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b119a4e8-12b1-42ea-9520-719a7d416662 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:13.302996 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b119a4e8-12b1-42ea-9520-719a7d416662 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:13.303510 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b119a4e8-12b1-42ea-9520-719a7d416662 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:13.363145 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:13.379512 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:13.385271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:13.390638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cc1f8944-82f2-40a6-857f-419a9b058b50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.276023 Jun 17 07:35:13.391230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 63/122] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:13 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:35:13.465721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b119a4e8-12b1-42ea-9520-719a7d416662 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:13.475177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b119a4e8-12b1-42ea-9520-719a7d416662 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.184641 Jun 17 07:35:13.490417 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 60/123] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:13 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:14.228517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1dc0fdad-1376-4704-8a72-87da8ecfc432 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:14.229732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1dc0fdad-1376-4704-8a72-87da8ecfc432 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:14.235756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1dc0fdad-1376-4704-8a72-87da8ecfc432 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:14.236205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1dc0fdad-1376-4704-8a72-87da8ecfc432 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:14.236966 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1dc0fdad-1376-4704-8a72-87da8ecfc432 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:14.237424 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1dc0fdad-1376-4704-8a72-87da8ecfc432 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:14.372420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1dc0fdad-1376-4704-8a72-87da8ecfc432 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:14.385759 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1dc0fdad-1376-4704-8a72-87da8ecfc432 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.157833 Jun 17 07:35:14.385759 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 64/124] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:14 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:14.408901 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:14.409536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:14.416394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:14.416838 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:14.417657 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:14.418081 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:14.498413 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-84dba513-6f64-4886-b642-1349ffb7276d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:14.499279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-84dba513-6f64-4886-b642-1349ffb7276d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:14.506241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84dba513-6f64-4886-b642-1349ffb7276d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:14.506732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84dba513-6f64-4886-b642-1349ffb7276d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:14.507674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84dba513-6f64-4886-b642-1349ffb7276d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:14.508241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84dba513-6f64-4886-b642-1349ffb7276d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:14.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:14.713673 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:14.716245 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:14.717458 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c3516dc3-6176-4ccf-a51c-bbb12ee05347 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.312534 Jun 17 07:35:14.718025 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 61/125] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:14 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:14.753055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-84dba513-6f64-4886-b642-1349ffb7276d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:14.772736 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-84dba513-6f64-4886-b642-1349ffb7276d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.276880 Jun 17 07:35:14.775917 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 65/126] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:14 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:15.400165 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-23704b24-882b-48cf-8c5c-713f5e782958 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:15.400779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-23704b24-882b-48cf-8c5c-713f5e782958 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:15.407505 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-23704b24-882b-48cf-8c5c-713f5e782958 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:15.408054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-23704b24-882b-48cf-8c5c-713f5e782958 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:15.408770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-23704b24-882b-48cf-8c5c-713f5e782958 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:15.409209 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-23704b24-882b-48cf-8c5c-713f5e782958 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:15.582832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-23704b24-882b-48cf-8c5c-713f5e782958 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:15.595461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-23704b24-882b-48cf-8c5c-713f5e782958 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.197424 Jun 17 07:35:15.595461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 62/127] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:15 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:15.737167 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:15.737874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:15.739839 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:15.747384 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:15.750497 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:15.750497 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:15.750497 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:15.792554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-627023ef-9d63-4b5d-b286-18394eef3cee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:15.796493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-627023ef-9d63-4b5d-b286-18394eef3cee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:15.799751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-627023ef-9d63-4b5d-b286-18394eef3cee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:15.800196 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-627023ef-9d63-4b5d-b286-18394eef3cee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:15.800958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-627023ef-9d63-4b5d-b286-18394eef3cee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:15.801423 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-627023ef-9d63-4b5d-b286-18394eef3cee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:15.885111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:15.893234 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:15.894770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:15.895881 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-84c2f419-016d-4c8d-9b9e-d72483b659ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.162619 Jun 17 07:35:15.896448 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 66/128] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:15 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:15.945210 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-627023ef-9d63-4b5d-b286-18394eef3cee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:15.953962 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-627023ef-9d63-4b5d-b286-18394eef3cee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.166184 Jun 17 07:35:15.955161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 63/129] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:15 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:16.541232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-d0924824-d68d-49c3-92cf-f62e9121caa4 req-055130f0-f002-4ab4-bed1-eb09a7ef2735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e997afb-9a72-40c0-8b38-871954558286", "name": "network-vif-plugged", "status": "completed", "tag": "5366877e-faf9-4498-943a-cff8f23c175e"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:16.551042 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-d0924824-d68d-49c3-92cf-f62e9121caa4 req-055130f0-f002-4ab4-bed1-eb09a7ef2735 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:16.551589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-d0924824-d68d-49c3-92cf-f62e9121caa4 req-055130f0-f002-4ab4-bed1-eb09a7ef2735 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:16.565144 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-d0924824-d68d-49c3-92cf-f62e9121caa4 req-055130f0-f002-4ab4-bed1-eb09a7ef2735 service nova] Creating event network-vif-plugged:5366877e-faf9-4498-943a-cff8f23c175e for instance 4e997afb-9a72-40c0-8b38-871954558286 on hv-cinder-79733 Jun 17 07:35:16.570518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-d0924824-d68d-49c3-92cf-f62e9121caa4 req-055130f0-f002-4ab4-bed1-eb09a7ef2735 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102687 Jun 17 07:35:16.571654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 67/130] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:35:16.612870 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-de7282c3-d36c-4e64-bf69-abca12fcd99d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:16.614630 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-de7282c3-d36c-4e64-bf69-abca12fcd99d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:16.621053 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de7282c3-d36c-4e64-bf69-abca12fcd99d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:16.621532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de7282c3-d36c-4e64-bf69-abca12fcd99d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:16.624389 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de7282c3-d36c-4e64-bf69-abca12fcd99d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:16.625147 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de7282c3-d36c-4e64-bf69-abca12fcd99d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:16.776831 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-de7282c3-d36c-4e64-bf69-abca12fcd99d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:16.784593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-de7282c3-d36c-4e64-bf69-abca12fcd99d tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.176890 Jun 17 07:35:16.785845 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 64/131] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:16 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:16.918312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:16.918731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:16.932460 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:16.934207 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:16.938403 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:16.939118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:16.972536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4e5776e5-c64d-4f8f-b857-242f073e984d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:16.973398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4e5776e5-c64d-4f8f-b857-242f073e984d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:16.985648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4e5776e5-c64d-4f8f-b857-242f073e984d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:16.987556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4e5776e5-c64d-4f8f-b857-242f073e984d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:16.989825 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4e5776e5-c64d-4f8f-b857-242f073e984d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:16.990468 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4e5776e5-c64d-4f8f-b857-242f073e984d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:17.426110 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:17.435656 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:17.437436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:17.438647 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d92ce7ff-4ad4-46fb-a794-f5caabeef265 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.525838 Jun 17 07:35:17.439315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 68/132] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:16 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:17.803886 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-974157df-d8d7-4326-a7be-74d92a5b745c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:17.804636 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-974157df-d8d7-4326-a7be-74d92a5b745c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:17.812177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-974157df-d8d7-4326-a7be-74d92a5b745c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:17.812713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-974157df-d8d7-4326-a7be-74d92a5b745c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:17.813612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-974157df-d8d7-4326-a7be-74d92a5b745c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:17.814405 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-974157df-d8d7-4326-a7be-74d92a5b745c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:17.823829 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4e5776e5-c64d-4f8f-b857-242f073e984d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:17.828902 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4e5776e5-c64d-4f8f-b857-242f073e984d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.861274 Jun 17 07:35:17.829518 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 65/133] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:16 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:18.423592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-974157df-d8d7-4326-a7be-74d92a5b745c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:18.435415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-974157df-d8d7-4326-a7be-74d92a5b745c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.635608 Jun 17 07:35:18.448064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 69/134] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:17 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:18.463794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:18.464301 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:18.471449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:18.473155 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:18.473862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:18.474851 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:18.475454 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:18.721040 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:18.730197 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:18.731705 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:18.732823 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-85c4fe69-f132-44fc-96f5-9adf318db4b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.274395 Jun 17 07:35:18.733637 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 66/135] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:18 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:18.846618 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-77fd6648-33ca-4d28-8f09-dfd4c9045a61 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:18.847302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-77fd6648-33ca-4d28-8f09-dfd4c9045a61 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:18.853761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-77fd6648-33ca-4d28-8f09-dfd4c9045a61 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:18.854273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-77fd6648-33ca-4d28-8f09-dfd4c9045a61 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:18.855336 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-77fd6648-33ca-4d28-8f09-dfd4c9045a61 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:18.855431 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-77fd6648-33ca-4d28-8f09-dfd4c9045a61 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:19.048478 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-b50e90ca-63b0-4c73-8291-4a7168ee427a req-d5b9775a-c901-473e-ae0e-e4dde5557aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ad6743-cfda-46c3-afaa-6d54e2e80a2f", "tag": "1ce3a745-be88-4264-b1e5-51f76662590d"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:19.058697 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-b50e90ca-63b0-4c73-8291-4a7168ee427a req-d5b9775a-c901-473e-ae0e-e4dde5557aef service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:19.059148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-b50e90ca-63b0-4c73-8291-4a7168ee427a req-d5b9775a-c901-473e-ae0e-e4dde5557aef service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:19.075848 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-b50e90ca-63b0-4c73-8291-4a7168ee427a req-d5b9775a-c901-473e-ae0e-e4dde5557aef service nova] Creating event network-changed:1ce3a745-be88-4264-b1e5-51f76662590d for instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f on hv-cinder-79733 Jun 17 07:35:19.081642 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-b50e90ca-63b0-4c73-8291-4a7168ee427a req-d5b9775a-c901-473e-ae0e-e4dde5557aef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036868 Jun 17 07:35:19.082814 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 67/136] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:35:19.107616 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-77fd6648-33ca-4d28-8f09-dfd4c9045a61 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:19.119219 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-77fd6648-33ca-4d28-8f09-dfd4c9045a61 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.276066 Jun 17 07:35:19.120222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 70/137] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:18 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:19.454716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fc60ce3f-57e7-4775-9056-c19eed0d22c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:19.455550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fc60ce3f-57e7-4775-9056-c19eed0d22c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:19.462177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc60ce3f-57e7-4775-9056-c19eed0d22c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:19.462626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc60ce3f-57e7-4775-9056-c19eed0d22c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:19.463381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc60ce3f-57e7-4775-9056-c19eed0d22c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:19.463833 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc60ce3f-57e7-4775-9056-c19eed0d22c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:19.628204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fc60ce3f-57e7-4775-9056-c19eed0d22c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:19.636380 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fc60ce3f-57e7-4775-9056-c19eed0d22c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.186357 Jun 17 07:35:19.636956 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 68/138] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:19 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:19.751676 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:19.752226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:19.759271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:19.766896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:19.766896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:19.766896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:19.934823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:19.946425 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:19.946999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:19.948511 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-13e68e24-7f44-421c-9897-5e111ea7585f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.201195 Jun 17 07:35:19.949241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 71/139] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:19 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:20.144394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-60242cb4-fdaf-49e8-a19f-7b9636bef9a3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:20.145093 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-60242cb4-fdaf-49e8-a19f-7b9636bef9a3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:20.151466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60242cb4-fdaf-49e8-a19f-7b9636bef9a3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:20.152011 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60242cb4-fdaf-49e8-a19f-7b9636bef9a3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:20.152856 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60242cb4-fdaf-49e8-a19f-7b9636bef9a3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:20.153386 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60242cb4-fdaf-49e8-a19f-7b9636bef9a3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:20.361294 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-60242cb4-fdaf-49e8-a19f-7b9636bef9a3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:20.369711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-60242cb4-fdaf-49e8-a19f-7b9636bef9a3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.229708 Jun 17 07:35:20.370643 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 69/140] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:20 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:20.654063 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bc2d425f-d8f6-4296-bca6-b7bad5d58e41 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:20.655064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-bc2d425f-d8f6-4296-bca6-b7bad5d58e41 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:20.662250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bc2d425f-d8f6-4296-bca6-b7bad5d58e41 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:20.662942 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bc2d425f-d8f6-4296-bca6-b7bad5d58e41 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:20.663739 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bc2d425f-d8f6-4296-bca6-b7bad5d58e41 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:20.664791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bc2d425f-d8f6-4296-bca6-b7bad5d58e41 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:20.809070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-bc2d425f-d8f6-4296-bca6-b7bad5d58e41 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:20.812915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:20.817546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-bc2d425f-d8f6-4296-bca6-b7bad5d58e41 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.168010 Jun 17 07:35:20.818129 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 72/141] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:20 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:20.971292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:20.972041 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:20.981338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:20.981830 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:20.982765 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:20.983200 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:21.141623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:21.150048 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:21.151566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:21.152713 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9707f814-6dae-42a4-b725-09014d663f7f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.185461 Jun 17 07:35:21.153275 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 70/142] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:20 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:21.387833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-aafe8478-b305-4fda-832c-9c73b3ad9f95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:21.388536 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-aafe8478-b305-4fda-832c-9c73b3ad9f95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:21.395023 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aafe8478-b305-4fda-832c-9c73b3ad9f95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:21.395464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aafe8478-b305-4fda-832c-9c73b3ad9f95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:21.396219 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aafe8478-b305-4fda-832c-9c73b3ad9f95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:21.396645 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aafe8478-b305-4fda-832c-9c73b3ad9f95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:21.536783 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-aafe8478-b305-4fda-832c-9c73b3ad9f95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:21.550841 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-aafe8478-b305-4fda-832c-9c73b3ad9f95 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.166072 Jun 17 07:35:21.550841 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 73/143] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:21 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:21.835609 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f9cc5cc0-2fd1-4f60-b6d5-f54fc6ae78e5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:21.836790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f9cc5cc0-2fd1-4f60-b6d5-f54fc6ae78e5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:21.843022 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f9cc5cc0-2fd1-4f60-b6d5-f54fc6ae78e5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:21.843467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f9cc5cc0-2fd1-4f60-b6d5-f54fc6ae78e5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:21.844406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f9cc5cc0-2fd1-4f60-b6d5-f54fc6ae78e5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:21.844845 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f9cc5cc0-2fd1-4f60-b6d5-f54fc6ae78e5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:21.993702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f9cc5cc0-2fd1-4f60-b6d5-f54fc6ae78e5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:22.001618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f9cc5cc0-2fd1-4f60-b6d5-f54fc6ae78e5 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.169883 Jun 17 07:35:22.002192 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 71/144] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:21 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:22.170753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:22.171349 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:22.177342 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:22.177811 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:22.178541 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:22.178970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:22.323270 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:22.331737 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:22.333508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:22.334609 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0ef4894c-192a-4fdf-b59c-3573308fb339 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.167687 Jun 17 07:35:22.335320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 74/145] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:22 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:22.568018 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f8ab706f-69d5-42c4-8e7e-49ee45470cae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:22.568698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f8ab706f-69d5-42c4-8e7e-49ee45470cae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:22.575820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f8ab706f-69d5-42c4-8e7e-49ee45470cae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:22.576261 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f8ab706f-69d5-42c4-8e7e-49ee45470cae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:22.578549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f8ab706f-69d5-42c4-8e7e-49ee45470cae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:22.578549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f8ab706f-69d5-42c4-8e7e-49ee45470cae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:22.731136 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f8ab706f-69d5-42c4-8e7e-49ee45470cae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:22.740128 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f8ab706f-69d5-42c4-8e7e-49ee45470cae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.174788 Jun 17 07:35:22.740880 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 72/146] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:22 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:23.019668 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a52f51ec-7127-472f-9197-a478ddc093c8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:23.020275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a52f51ec-7127-472f-9197-a478ddc093c8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:23.026889 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a52f51ec-7127-472f-9197-a478ddc093c8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:23.027338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a52f51ec-7127-472f-9197-a478ddc093c8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:23.028100 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a52f51ec-7127-472f-9197-a478ddc093c8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:23.028532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a52f51ec-7127-472f-9197-a478ddc093c8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:23.166727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a52f51ec-7127-472f-9197-a478ddc093c8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:23.174417 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a52f51ec-7127-472f-9197-a478ddc093c8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.158471 Jun 17 07:35:23.175020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 75/147] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:23 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:23.353449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:23.354054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:23.360779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:23.361250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:23.362003 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:23.362512 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:23.510528 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:23.518690 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:23.520184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:23.521279 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a73501c0-e411-454b-94b4-8892e84c31e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.171918 Jun 17 07:35:23.521863 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 73/148] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:23 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:23.759095 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e074ce28-4e53-4f3b-aad7-bcd882883f93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:23.759095 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e074ce28-4e53-4f3b-aad7-bcd882883f93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:23.765773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e074ce28-4e53-4f3b-aad7-bcd882883f93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:23.766224 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e074ce28-4e53-4f3b-aad7-bcd882883f93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:23.766993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e074ce28-4e53-4f3b-aad7-bcd882883f93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:23.767428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e074ce28-4e53-4f3b-aad7-bcd882883f93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:23.917372 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e074ce28-4e53-4f3b-aad7-bcd882883f93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:23.924597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e074ce28-4e53-4f3b-aad7-bcd882883f93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.170588 Jun 17 07:35:23.935358 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:23 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:24.192385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6da914cf-65f4-498f-9ef6-20078729902e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:24.193085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6da914cf-65f4-498f-9ef6-20078729902e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:24.200973 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6da914cf-65f4-498f-9ef6-20078729902e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:24.200973 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6da914cf-65f4-498f-9ef6-20078729902e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:24.200973 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6da914cf-65f4-498f-9ef6-20078729902e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:24.200973 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6da914cf-65f4-498f-9ef6-20078729902e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:24.204828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:24.342181 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6da914cf-65f4-498f-9ef6-20078729902e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:24.349573 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6da914cf-65f4-498f-9ef6-20078729902e tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.161043 Jun 17 07:35:24.350389 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 74/150] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:24 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:24.539525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:24.541013 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:24.547313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:24.547924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:24.549128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:24.549804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:24.706782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:24.719674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:24.721176 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:24.722335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-df7b23d9-86fb-49a3-b380-2509c9ca4ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.186816 Jun 17 07:35:24.722929 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 77/151] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:24 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:24.942625 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-47922014-ab69-45a6-ac5d-1c567fea5884 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:24.943229 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-47922014-ab69-45a6-ac5d-1c567fea5884 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:24.950388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-47922014-ab69-45a6-ac5d-1c567fea5884 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:24.953488 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-47922014-ab69-45a6-ac5d-1c567fea5884 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:24.953488 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-47922014-ab69-45a6-ac5d-1c567fea5884 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:24.953488 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-47922014-ab69-45a6-ac5d-1c567fea5884 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:25.107265 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-47922014-ab69-45a6-ac5d-1c567fea5884 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:25.123720 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-47922014-ab69-45a6-ac5d-1c567fea5884 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.183731 Jun 17 07:35:25.126234 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 75/152] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:24 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:25.296773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-c1f4e0ac-b49e-4dbf-98f3-fe1d8d254018 req-6821f4c1-6eaf-43e6-90ba-8ac956ec55ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890073f7-7e31-4a66-85bf-99292054e64f", "name": "network-vif-plugged", "status": "completed", "tag": "20c496e9-41d6-48b1-8faf-5a524259d80b"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:25.309957 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c1f4e0ac-b49e-4dbf-98f3-fe1d8d254018 req-6821f4c1-6eaf-43e6-90ba-8ac956ec55ec service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:25.311914 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c1f4e0ac-b49e-4dbf-98f3-fe1d8d254018 req-6821f4c1-6eaf-43e6-90ba-8ac956ec55ec service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:25.328671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-c1f4e0ac-b49e-4dbf-98f3-fe1d8d254018 req-6821f4c1-6eaf-43e6-90ba-8ac956ec55ec service nova] Creating event network-vif-plugged:20c496e9-41d6-48b1-8faf-5a524259d80b for instance 890073f7-7e31-4a66-85bf-99292054e64f on hv-cinder-79733 Jun 17 07:35:25.335672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-c1f4e0ac-b49e-4dbf-98f3-fe1d8d254018 req-6821f4c1-6eaf-43e6-90ba-8ac956ec55ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042230 Jun 17 07:35:25.336625 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 78/153] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:35:25.369855 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cadd64b5-04cf-4902-adaa-b71bd0b885a4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:25.370483 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cadd64b5-04cf-4902-adaa-b71bd0b885a4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:25.380507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cadd64b5-04cf-4902-adaa-b71bd0b885a4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:25.380977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cadd64b5-04cf-4902-adaa-b71bd0b885a4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:25.382005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cadd64b5-04cf-4902-adaa-b71bd0b885a4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:25.382528 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cadd64b5-04cf-4902-adaa-b71bd0b885a4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:25.581223 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cadd64b5-04cf-4902-adaa-b71bd0b885a4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:25.589688 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cadd64b5-04cf-4902-adaa-b71bd0b885a4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.226215 Jun 17 07:35:25.590281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 76/154] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:25 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:25.742236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:25.744399 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:25.751896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:25.752348 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:25.753146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:25.753609 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:25.940662 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:25.951962 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:25.953844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:25.955006 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f94e89d8-6d3b-4309-9619-d8c0d903ecf4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.218686 Jun 17 07:35:25.957488 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 79/155] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:25 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:26.141673 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-94243519-d8f6-43c9-a77a-e48a8bd23654 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:26.142333 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-94243519-d8f6-43c9-a77a-e48a8bd23654 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:26.148773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-94243519-d8f6-43c9-a77a-e48a8bd23654 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:26.149453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-94243519-d8f6-43c9-a77a-e48a8bd23654 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:26.150242 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-94243519-d8f6-43c9-a77a-e48a8bd23654 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:26.150680 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-94243519-d8f6-43c9-a77a-e48a8bd23654 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:26.397305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-94243519-d8f6-43c9-a77a-e48a8bd23654 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:26.407735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-94243519-d8f6-43c9-a77a-e48a8bd23654 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.269891 Jun 17 07:35:26.408475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 77/156] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:26 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:26.609695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cbe9ec46-8c7b-4100-8457-de2ff72d89f6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:26.610968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cbe9ec46-8c7b-4100-8457-de2ff72d89f6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:26.625689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cbe9ec46-8c7b-4100-8457-de2ff72d89f6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:26.625689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cbe9ec46-8c7b-4100-8457-de2ff72d89f6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:26.625689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cbe9ec46-8c7b-4100-8457-de2ff72d89f6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:26.625689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cbe9ec46-8c7b-4100-8457-de2ff72d89f6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:26.776264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cbe9ec46-8c7b-4100-8457-de2ff72d89f6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:26.783756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cbe9ec46-8c7b-4100-8457-de2ff72d89f6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.179836 Jun 17 07:35:26.784335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 80/157] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:26 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:26.993812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:26.994855 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:27.001477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:27.001925 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:27.002687 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:27.003582 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:27.324529 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:27.347213 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:27.351501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:27.354273 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0a9bf554-47cf-4e57-af57-dd4273479c03 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.380249 Jun 17 07:35:27.356815 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 78/158] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:26 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:27.428243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-af971453-fb41-421a-ab60-a13fff728930 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:27.428243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-af971453-fb41-421a-ab60-a13fff728930 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:27.446702 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-af971453-fb41-421a-ab60-a13fff728930 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:27.448072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-af971453-fb41-421a-ab60-a13fff728930 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:27.449286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-af971453-fb41-421a-ab60-a13fff728930 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:27.451009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-af971453-fb41-421a-ab60-a13fff728930 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:27.802209 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e8b2fab9-14ad-4ae5-9567-e3cfa488a3e6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:27.803411 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e8b2fab9-14ad-4ae5-9567-e3cfa488a3e6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:27.810306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8b2fab9-14ad-4ae5-9567-e3cfa488a3e6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:27.811024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8b2fab9-14ad-4ae5-9567-e3cfa488a3e6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:27.813553 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8b2fab9-14ad-4ae5-9567-e3cfa488a3e6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:27.813553 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8b2fab9-14ad-4ae5-9567-e3cfa488a3e6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:27.833735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-af971453-fb41-421a-ab60-a13fff728930 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:27.854591 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-af971453-fb41-421a-ab60-a13fff728930 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.432277 Jun 17 07:35:27.855670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 81/159] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:27 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:28.242662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e8b2fab9-14ad-4ae5-9567-e3cfa488a3e6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:28.251754 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e8b2fab9-14ad-4ae5-9567-e3cfa488a3e6 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.452980 Jun 17 07:35:28.263123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 79/160] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:27 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:28.372193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:28.372709 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:28.378916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:28.379360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:28.380136 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:28.380571 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:28.538019 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:28.548929 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:28.550442 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:28.551728 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-27f5773d-5743-4d6d-8b3a-45db135a8f14 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.183567 Jun 17 07:35:28.552312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 82/161] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:28 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:28.872808 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-98db1e77-cd44-4243-b3e9-9d9add06a78d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:28.873733 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-98db1e77-cd44-4243-b3e9-9d9add06a78d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:28.879990 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-98db1e77-cd44-4243-b3e9-9d9add06a78d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:28.880364 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-98db1e77-cd44-4243-b3e9-9d9add06a78d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:28.881120 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-98db1e77-cd44-4243-b3e9-9d9add06a78d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:28.881611 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-98db1e77-cd44-4243-b3e9-9d9add06a78d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:29.018017 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-98db1e77-cd44-4243-b3e9-9d9add06a78d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:29.045141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-98db1e77-cd44-4243-b3e9-9d9add06a78d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.175037 Jun 17 07:35:29.045141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 80/162] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:28 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:29.270168 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-52bef6e5-aa0b-48cf-a693-7824d12c3eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:29.270765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-52bef6e5-aa0b-48cf-a693-7824d12c3eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:29.277282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52bef6e5-aa0b-48cf-a693-7824d12c3eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:29.277757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52bef6e5-aa0b-48cf-a693-7824d12c3eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:29.278533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52bef6e5-aa0b-48cf-a693-7824d12c3eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:29.279008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52bef6e5-aa0b-48cf-a693-7824d12c3eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:29.392104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-01d0097a-e162-4aa7-a9b5-3b30f5428b07 req-7bf93b84-480e-4a4c-af0d-513616c5aa53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5abf359-6883-489c-b6bc-d6456efc857d", "name": "network-vif-plugged", "status": "completed", "tag": "d8ca212b-ae6d-40b5-8948-4d106f1e7165"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:29.402249 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-01d0097a-e162-4aa7-a9b5-3b30f5428b07 req-7bf93b84-480e-4a4c-af0d-513616c5aa53 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:29.403077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-01d0097a-e162-4aa7-a9b5-3b30f5428b07 req-7bf93b84-480e-4a4c-af0d-513616c5aa53 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:29.418251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-01d0097a-e162-4aa7-a9b5-3b30f5428b07 req-7bf93b84-480e-4a4c-af0d-513616c5aa53 service nova] Creating event network-vif-plugged:d8ca212b-ae6d-40b5-8948-4d106f1e7165 for instance e5abf359-6883-489c-b6bc-d6456efc857d on hv-cinder-79733 Jun 17 07:35:29.426382 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-01d0097a-e162-4aa7-a9b5-3b30f5428b07 req-7bf93b84-480e-4a4c-af0d-513616c5aa53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040732 Jun 17 07:35:29.432148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 81/163] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:35:29.518795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-52bef6e5-aa0b-48cf-a693-7824d12c3eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:29.533017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-52bef6e5-aa0b-48cf-a693-7824d12c3eb0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1313 microversion: 2.1 time: 0.265545 Jun 17 07:35:29.535986 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 83/164] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:29 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:29.572402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:29.573163 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:29.581570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:29.582001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:29.583085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:29.583682 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:29.776639 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:29.788084 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:29.793603 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:29.796514 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-feaa0e87-ee17-4259-8cf7-d8a0b516efd3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.229753 Jun 17 07:35:29.808019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 82/165] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:29 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:30.070144 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-444ca6e6-2854-4a85-a353-b2e9bb3b6552 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:30.071072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-444ca6e6-2854-4a85-a353-b2e9bb3b6552 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:30.079168 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-444ca6e6-2854-4a85-a353-b2e9bb3b6552 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:30.079960 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-444ca6e6-2854-4a85-a353-b2e9bb3b6552 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:30.081584 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-444ca6e6-2854-4a85-a353-b2e9bb3b6552 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:30.082254 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-444ca6e6-2854-4a85-a353-b2e9bb3b6552 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:30.329552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-444ca6e6-2854-4a85-a353-b2e9bb3b6552 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:30.338257 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-444ca6e6-2854-4a85-a353-b2e9bb3b6552 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1322 microversion: 2.1 time: 0.280539 Jun 17 07:35:30.338850 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 84/166] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:30 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:30.552398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-429da860-418e-4dd3-a0c4-922155d9ecd4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:30.554009 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-429da860-418e-4dd3-a0c4-922155d9ecd4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:30.561749 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-429da860-418e-4dd3-a0c4-922155d9ecd4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:30.562455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-429da860-418e-4dd3-a0c4-922155d9ecd4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:30.563594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-429da860-418e-4dd3-a0c4-922155d9ecd4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:30.564184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-429da860-418e-4dd3-a0c4-922155d9ecd4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:30.712369 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-429da860-418e-4dd3-a0c4-922155d9ecd4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:30.721491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-429da860-418e-4dd3-a0c4-922155d9ecd4 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1498 microversion: 2.1 time: 0.173396 Jun 17 07:35:30.722271 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 83/167] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:30 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:30.816723 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:30.817693 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:30.843328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:30.845777 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:30.846749 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:30.849104 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:31.137495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:31.145644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:31.148200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:31.150502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-65dfc929-086a-4db8-aaee-5a7c1cbca1d4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.338212 Jun 17 07:35:31.151350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 85/168] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:30 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:31.358041 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-79d9972c-1fba-406a-aa8c-4881377a1df6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:31.359893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-79d9972c-1fba-406a-aa8c-4881377a1df6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:31.366438 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=83 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:31.370174 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-79d9972c-1fba-406a-aa8c-4881377a1df6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:31.371395 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-79d9972c-1fba-406a-aa8c-4881377a1df6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:31.372851 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-79d9972c-1fba-406a-aa8c-4881377a1df6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:31.373885 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-79d9972c-1fba-406a-aa8c-4881377a1df6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:31.567628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-79d9972c-1fba-406a-aa8c-4881377a1df6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:31.577218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-79d9972c-1fba-406a-aa8c-4881377a1df6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1515 microversion: 2.1 time: 0.224839 Jun 17 07:35:31.577856 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 84/169] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:31 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:31.594268 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7c065a0f-4c22-4c5c-b82b-6681cc6dc60e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:31.595299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7c065a0f-4c22-4c5c-b82b-6681cc6dc60e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:31.603394 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c065a0f-4c22-4c5c-b82b-6681cc6dc60e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:31.604889 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c065a0f-4c22-4c5c-b82b-6681cc6dc60e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:31.606043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c065a0f-4c22-4c5c-b82b-6681cc6dc60e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:31.608171 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c065a0f-4c22-4c5c-b82b-6681cc6dc60e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:31.742934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-7c065a0f-4c22-4c5c-b82b-6681cc6dc60e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lazy-loading 'flavor' on Instance uuid 890073f7-7e31-4a66-85bf-99292054e64f {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:35:32.136546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7c065a0f-4c22-4c5c-b82b-6681cc6dc60e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f/action" status: 200 len: 32 microversion: 2.1 time: 0.546186 Jun 17 07:35:32.137195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 86/170] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:35:31 2022] POST /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f/action => generated 32 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 07:35:32.146657 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8fb5c45a-3fc3-4083-ba60-1b6821f75071 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:32.147559 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8fb5c45a-3fc3-4083-ba60-1b6821f75071 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:32.157485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8fb5c45a-3fc3-4083-ba60-1b6821f75071 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:32.166862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8fb5c45a-3fc3-4083-ba60-1b6821f75071 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:32.166862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8fb5c45a-3fc3-4083-ba60-1b6821f75071 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:32.166862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8fb5c45a-3fc3-4083-ba60-1b6821f75071 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:32.171279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:32.172716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:32.180773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:32.181614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:32.182948 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:32.183676 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:32.390571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8fb5c45a-3fc3-4083-ba60-1b6821f75071 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:32.400047 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8fb5c45a-3fc3-4083-ba60-1b6821f75071 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.257381 Jun 17 07:35:32.401024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 85/171] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:32 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:32.432448 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:32.442205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:32.443972 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:32.445233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-01f31096-38f0-42e9-8276-6165b21354e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.279982 Jun 17 07:35:32.446018 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 87/172] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:32 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:35:33.417552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d707b090-6ab2-422c-8a7b-8ab3d2ec616f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:33.418159 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d707b090-6ab2-422c-8a7b-8ab3d2ec616f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:33.424947 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d707b090-6ab2-422c-8a7b-8ab3d2ec616f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:33.428451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d707b090-6ab2-422c-8a7b-8ab3d2ec616f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:33.428451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d707b090-6ab2-422c-8a7b-8ab3d2ec616f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:33.428451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d707b090-6ab2-422c-8a7b-8ab3d2ec616f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:33.464225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:33.464941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:33.467252 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=81 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:33.472047 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:33.472495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:33.473352 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:33.473782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:33.478424 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:33.598002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d707b090-6ab2-422c-8a7b-8ab3d2ec616f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:33.601505 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d707b090-6ab2-422c-8a7b-8ab3d2ec616f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.187751 Jun 17 07:35:33.602904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 86/173] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:33 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:33.678712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d80b12d7-7d4a-4c55-a7f3-9bbf413c1dda tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91bd15dc-1b27-4788-a7ce-2f44c08e0835"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:33.682548 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d80b12d7-7d4a-4c55-a7f3-9bbf413c1dda tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:33.691996 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d80b12d7-7d4a-4c55-a7f3-9bbf413c1dda tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:33.692739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d80b12d7-7d4a-4c55-a7f3-9bbf413c1dda tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:33.693764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d80b12d7-7d4a-4c55-a7f3-9bbf413c1dda tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:33.694288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d80b12d7-7d4a-4c55-a7f3-9bbf413c1dda tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:33.803527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:33.814120 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:33.816150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:33.817366 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-295c4bb9-17cc-496b-93fb-7b262eff4ab9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.358091 Jun 17 07:35:33.817988 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 88/174] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:33 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:35:34.628554 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2a8f38a6-f371-4fb1-8fdb-12772658e5da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:34.632621 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2a8f38a6-f371-4fb1-8fdb-12772658e5da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:34.637870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a8f38a6-f371-4fb1-8fdb-12772658e5da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:34.638559 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a8f38a6-f371-4fb1-8fdb-12772658e5da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:34.639500 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a8f38a6-f371-4fb1-8fdb-12772658e5da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:34.640071 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a8f38a6-f371-4fb1-8fdb-12772658e5da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:34.800994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2a8f38a6-f371-4fb1-8fdb-12772658e5da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:34.809227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2a8f38a6-f371-4fb1-8fdb-12772658e5da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.193265 Jun 17 07:35:34.809878 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 89/175] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:34 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:34.838188 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:34.840595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:34.848246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:34.848695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:34.849489 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:34.849906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:35.062583 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:35.072697 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:35.074768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:35.075904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1d55d739-672c-4768-9a3e-9d83b03d5c50 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.243876 Jun 17 07:35:35.076624 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 90/176] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:34 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:35:35.826283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c95a8985-e79b-4041-9d56-656eefde2928 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:35.826956 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c95a8985-e79b-4041-9d56-656eefde2928 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:35.834049 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c95a8985-e79b-4041-9d56-656eefde2928 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:35.835008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c95a8985-e79b-4041-9d56-656eefde2928 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:35.836036 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c95a8985-e79b-4041-9d56-656eefde2928 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:35.836550 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c95a8985-e79b-4041-9d56-656eefde2928 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:36.059667 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c95a8985-e79b-4041-9d56-656eefde2928 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:36.067936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c95a8985-e79b-4041-9d56-656eefde2928 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.245355 Jun 17 07:35:36.068531 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 91/177] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:35 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:36.096126 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:36.097647 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:36.108097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:36.108097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:36.108097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:36.108097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:36.268139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:36.280561 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:36.280561 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:36.281585 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e744506c-3ea9-4316-9f8a-220f6dc03dae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.189269 Jun 17 07:35:36.286988 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 92/178] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:36 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:35:36.296936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d80b12d7-7d4a-4c55-a7f3-9bbf413c1dda tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "POST /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.633831 Jun 17 07:35:36.302319 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 87/179] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:35:33 2022] POST /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286/os-volume_attachments => generated 194 bytes in 2636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:35:36.889282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-353340803", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "networks": [{"uuid": "6bd29aca-d311-4cc6-952e-92134474670f"}]}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:36.945877 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] validate_networks() for [('6bd29aca-d311-4cc6-952e-92134474670f', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:35:37.088262 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-33ec345d-9c82-4e9b-9d46-17fc3bd6244b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:37.089176 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-33ec345d-9c82-4e9b-9d46-17fc3bd6244b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:37.095738 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-33ec345d-9c82-4e9b-9d46-17fc3bd6244b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:37.096284 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-33ec345d-9c82-4e9b-9d46-17fc3bd6244b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:37.097107 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-33ec345d-9c82-4e9b-9d46-17fc3bd6244b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:37.097632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-33ec345d-9c82-4e9b-9d46-17fc3bd6244b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:37.290927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-33ec345d-9c82-4e9b-9d46-17fc3bd6244b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:37.299197 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-33ec345d-9c82-4e9b-9d46-17fc3bd6244b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.216533 Jun 17 07:35:37.311652 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 88/180] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:37 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:37.327501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:37.328113 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:37.334722 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:37.335118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:37.336914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:37.337385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:37.359846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:35:37.360449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:35:37.361077 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:35:37.361691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:35:37.362274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:35:37.374583 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:37.375450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:37.381058 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:37.381058 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:37.406131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Getting quotas for project 9e64e39b616246e6974808d3d435e8ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:35:37.411372 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Getting quotas for user d4eeb8684c1e4c8da065e92fc5f04c01 and project 9e64e39b616246e6974808d3d435e8ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:35:37.425108 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:35:37.432536 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:35:37.503644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:37.518381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:37.520005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:37.521133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a0376d34-60df-473a-83a7-42022a5659bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.208440 Jun 17 07:35:37.521735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 89/181] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:37 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:37.630558 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-45181465-45b2-44d7-af8e-0d20f30e72fb tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745031 Jun 17 07:35:37.631425 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 93/182] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:35:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:35:37.641700 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f175b27b-ca04-45b3-9f16-c02057517e25 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:37.642400 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f175b27b-ca04-45b3-9f16-c02057517e25 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:37.734833 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f175b27b-ca04-45b3-9f16-c02057517e25 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:37.744026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f175b27b-ca04-45b3-9f16-c02057517e25 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1218 microversion: 2.1 time: 0.106018 Jun 17 07:35:37.757545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 90/183] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:37 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:38.315905 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-25830a34-205e-4b5e-ba02-11dc21a3d7d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:38.317115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-25830a34-205e-4b5e-ba02-11dc21a3d7d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:38.328534 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-25830a34-205e-4b5e-ba02-11dc21a3d7d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:38.328913 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-25830a34-205e-4b5e-ba02-11dc21a3d7d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:38.331769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-25830a34-205e-4b5e-ba02-11dc21a3d7d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:38.332215 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-25830a34-205e-4b5e-ba02-11dc21a3d7d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:38.474988 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-25830a34-205e-4b5e-ba02-11dc21a3d7d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:38.482643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-25830a34-205e-4b5e-ba02-11dc21a3d7d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.170548 Jun 17 07:35:38.483235 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 94/184] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:38 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:38.540635 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:38.541245 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:38.548516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:38.548960 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:38.550810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:38.550810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:38.555130 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:38.695252 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:38.703835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:38.705550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:38.706857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-861c0557-1dd5-4fb6-ade1-14c55f3ed53f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.170987 Jun 17 07:35:38.707506 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 91/185] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:38 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:38.764071 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2e9f5ced-5158-4d93-89da-9496d9716ee2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:38.764686 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2e9f5ced-5158-4d93-89da-9496d9716ee2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:38.841740 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2e9f5ced-5158-4d93-89da-9496d9716ee2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:38.849469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2e9f5ced-5158-4d93-89da-9496d9716ee2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1218 microversion: 2.1 time: 0.089220 Jun 17 07:35:38.851420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 95/186] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:38 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:39.509027 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1bbcfc64-7f8c-40e2-9b2e-241ca63342c5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:39.509694 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1bbcfc64-7f8c-40e2-9b2e-241ca63342c5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:39.516930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1bbcfc64-7f8c-40e2-9b2e-241ca63342c5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:39.517399 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1bbcfc64-7f8c-40e2-9b2e-241ca63342c5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:39.518153 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1bbcfc64-7f8c-40e2-9b2e-241ca63342c5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:39.518681 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1bbcfc64-7f8c-40e2-9b2e-241ca63342c5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:39.583534 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-cff5fcfb-d5c1-4fa2-9821-4c25ded176cb req-c4bbb171-f392-4323-be1a-643b4602e05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ad6743-cfda-46c3-afaa-6d54e2e80a2f", "name": "network-vif-plugged", "status": "completed", "tag": "1ce3a745-be88-4264-b1e5-51f76662590d"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:39.597370 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-cff5fcfb-d5c1-4fa2-9821-4c25ded176cb req-c4bbb171-f392-4323-be1a-643b4602e05b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:39.597977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-cff5fcfb-d5c1-4fa2-9821-4c25ded176cb req-c4bbb171-f392-4323-be1a-643b4602e05b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:39.613491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-cff5fcfb-d5c1-4fa2-9821-4c25ded176cb req-c4bbb171-f392-4323-be1a-643b4602e05b service nova] Creating event network-vif-plugged:1ce3a745-be88-4264-b1e5-51f76662590d for instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f on hv-cinder-79733 Jun 17 07:35:39.619952 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-cff5fcfb-d5c1-4fa2-9821-4c25ded176cb req-c4bbb171-f392-4323-be1a-643b4602e05b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041225 Jun 17 07:35:39.620906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 96/187] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:35:39.702639 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1bbcfc64-7f8c-40e2-9b2e-241ca63342c5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:39.714651 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1bbcfc64-7f8c-40e2-9b2e-241ca63342c5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.218234 Jun 17 07:35:39.717752 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 92/188] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:39 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:39.728143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:39.730533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:39.736785 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:39.737575 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:39.738503 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:39.739076 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:39.875202 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-808ef3f6-274e-4a10-80d9-a0207f8d7a12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:39.877108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-808ef3f6-274e-4a10-80d9-a0207f8d7a12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:39.887784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-808ef3f6-274e-4a10-80d9-a0207f8d7a12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:39.888255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-808ef3f6-274e-4a10-80d9-a0207f8d7a12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:39.889043 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-808ef3f6-274e-4a10-80d9-a0207f8d7a12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:39.889508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-808ef3f6-274e-4a10-80d9-a0207f8d7a12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:39.920130 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:39.929577 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:39.938945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:39.945472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-da3abc77-2692-42da-8ea2-0016656a1cd2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.217888 Jun 17 07:35:39.945472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 97/189] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:39 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:40.001804 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-808ef3f6-274e-4a10-80d9-a0207f8d7a12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:40.014705 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-808ef3f6-274e-4a10-80d9-a0207f8d7a12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1270 microversion: 2.1 time: 0.150463 Jun 17 07:35:40.015371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 93/190] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:39 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:40.732906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-93614a4b-f5eb-4416-bb95-277c2e53e22d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:40.733700 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-93614a4b-f5eb-4416-bb95-277c2e53e22d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:40.741486 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93614a4b-f5eb-4416-bb95-277c2e53e22d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:40.742520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93614a4b-f5eb-4416-bb95-277c2e53e22d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:40.744696 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93614a4b-f5eb-4416-bb95-277c2e53e22d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:40.744696 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93614a4b-f5eb-4416-bb95-277c2e53e22d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:40.886640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-93614a4b-f5eb-4416-bb95-277c2e53e22d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:40.895388 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-93614a4b-f5eb-4416-bb95-277c2e53e22d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.166225 Jun 17 07:35:40.900489 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 98/191] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:40 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:40.962590 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:40.963340 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:40.975096 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:40.987869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:40.991000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:40.991763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:41.036767 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d80a8c53-bc9e-4840-bbbe-97b56c814784 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:41.037433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d80a8c53-bc9e-4840-bbbe-97b56c814784 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:41.047689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d80a8c53-bc9e-4840-bbbe-97b56c814784 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:41.048138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d80a8c53-bc9e-4840-bbbe-97b56c814784 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:41.048914 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d80a8c53-bc9e-4840-bbbe-97b56c814784 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:41.049365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d80a8c53-bc9e-4840-bbbe-97b56c814784 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:41.162365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d80a8c53-bc9e-4840-bbbe-97b56c814784 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:41.178537 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d80a8c53-bc9e-4840-bbbe-97b56c814784 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1278 microversion: 2.1 time: 0.146002 Jun 17 07:35:41.191107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 99/192] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:41 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:41.224406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:41.235685 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:41.237267 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:41.238611 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-aacc8cd5-9847-4b35-a385-a9afc5af16ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.282171 Jun 17 07:35:41.239183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 94/193] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:40 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:41.920335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-36633f2b-9052-4d7b-9041-b18cebef29a5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:41.920977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-36633f2b-9052-4d7b-9041-b18cebef29a5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:41.927790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-36633f2b-9052-4d7b-9041-b18cebef29a5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:41.928255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-36633f2b-9052-4d7b-9041-b18cebef29a5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:41.929223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-36633f2b-9052-4d7b-9041-b18cebef29a5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:41.930219 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-36633f2b-9052-4d7b-9041-b18cebef29a5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:42.076574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-36633f2b-9052-4d7b-9041-b18cebef29a5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:42.084426 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-36633f2b-9052-4d7b-9041-b18cebef29a5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.168164 Jun 17 07:35:42.085070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 100/194] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:41 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:42.200048 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9acf6124-66fb-4482-bb38-5735d6b06b66 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:42.201079 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9acf6124-66fb-4482-bb38-5735d6b06b66 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:42.209114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9acf6124-66fb-4482-bb38-5735d6b06b66 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:42.209971 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9acf6124-66fb-4482-bb38-5735d6b06b66 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:42.210954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9acf6124-66fb-4482-bb38-5735d6b06b66 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:42.211557 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9acf6124-66fb-4482-bb38-5735d6b06b66 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:42.260182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:42.261027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:42.267077 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:42.267518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:42.268283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:42.268866 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:42.372925 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9acf6124-66fb-4482-bb38-5735d6b06b66 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:42.384005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9acf6124-66fb-4482-bb38-5735d6b06b66 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.189388 Jun 17 07:35:42.386237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 95/195] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:42 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:42.515243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:42.524869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:42.526571 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:42.527779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7aee59ec-8c6e-4fbb-a597-cae9604e2820 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1405 microversion: 2.20 time: 0.274077 Jun 17 07:35:42.528569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 101/196] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:42 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:43.115457 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7ad0bab4-0cd6-4a90-bf8b-81a7e4c02e48 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:43.117110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7ad0bab4-0cd6-4a90-bf8b-81a7e4c02e48 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:43.129671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ad0bab4-0cd6-4a90-bf8b-81a7e4c02e48 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.135939 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ad0bab4-0cd6-4a90-bf8b-81a7e4c02e48 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.143834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ad0bab4-0cd6-4a90-bf8b-81a7e4c02e48 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.143834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ad0bab4-0cd6-4a90-bf8b-81a7e4c02e48 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.404673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2eaea7d9-d763-47f7-988e-3b63172e9b7e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:43.405450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2eaea7d9-d763-47f7-988e-3b63172e9b7e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:43.412103 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2eaea7d9-d763-47f7-988e-3b63172e9b7e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.421950 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2eaea7d9-d763-47f7-988e-3b63172e9b7e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.422904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2eaea7d9-d763-47f7-988e-3b63172e9b7e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.423416 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2eaea7d9-d763-47f7-988e-3b63172e9b7e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.581473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7ad0bab4-0cd6-4a90-bf8b-81a7e4c02e48 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:43.592519 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7ad0bab4-0cd6-4a90-bf8b-81a7e4c02e48 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.489426 Jun 17 07:35:43.605847 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 96/197] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:43 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:43.610972 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-704dbf9e-d1ca-476a-8e97-ba54c70d5805 req-4c6aa9dc-4957-468a-a982-d3edc6c8647a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead8bc69-fb51-4feb-a5aa-893812890c54", "tag": "eb2093c5-84bc-4bb1-ba58-833eb8ee39a3"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:43.621652 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-704dbf9e-d1ca-476a-8e97-ba54c70d5805 req-4c6aa9dc-4957-468a-a982-d3edc6c8647a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.622389 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-704dbf9e-d1ca-476a-8e97-ba54c70d5805 req-4c6aa9dc-4957-468a-a982-d3edc6c8647a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.639285 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2eaea7d9-d763-47f7-988e-3b63172e9b7e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:43.652608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2eaea7d9-d763-47f7-988e-3b63172e9b7e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.248438 Jun 17 07:35:43.653297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 102/198] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:43 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:43.662306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-704dbf9e-d1ca-476a-8e97-ba54c70d5805 req-4c6aa9dc-4957-468a-a982-d3edc6c8647a service nova] Creating event network-changed:eb2093c5-84bc-4bb1-ba58-833eb8ee39a3 for instance ead8bc69-fb51-4feb-a5aa-893812890c54 on hv-cinder-79733 Jun 17 07:35:43.662487 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:43.662487 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:43.674337 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-704dbf9e-d1ca-476a-8e97-ba54c70d5805 req-4c6aa9dc-4957-468a-a982-d3edc6c8647a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060811 Jun 17 07:35:43.681492 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 97/199] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:35:43.689398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.689921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.690750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.696608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.834675 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:43.845283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:43.847567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:43.849523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-57e23c3c-a022-43d3-84da-41f6d0afe3b2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1598 microversion: 2.20 time: 0.195229 Jun 17 07:35:43.850711 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 103/200] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:35:43 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1598 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:35:43.869390 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d7875abf-9124-4bcd-8760-02c3f6a5ce61 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:43.870258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d7875abf-9124-4bcd-8760-02c3f6a5ce61 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:43.877720 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7875abf-9124-4bcd-8760-02c3f6a5ce61 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.878473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7875abf-9124-4bcd-8760-02c3f6a5ce61 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.880351 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7875abf-9124-4bcd-8760-02c3f6a5ce61 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:43.880689 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7875abf-9124-4bcd-8760-02c3f6a5ce61 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:43.966270 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d7875abf-9124-4bcd-8760-02c3f6a5ce61 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101235 Jun 17 07:35:43.966956 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 98/201] 10.222.0.52 () {60 vars in 1315 bytes} [Fri Jun 17 07:35:43 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:35:44.611413 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-da8b7aba-d3b5-46c4-bf68-7b9735a95990 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:44.612057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-da8b7aba-d3b5-46c4-bf68-7b9735a95990 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:44.635450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da8b7aba-d3b5-46c4-bf68-7b9735a95990 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:44.637572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da8b7aba-d3b5-46c4-bf68-7b9735a95990 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:44.641109 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da8b7aba-d3b5-46c4-bf68-7b9735a95990 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:44.643351 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da8b7aba-d3b5-46c4-bf68-7b9735a95990 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:44.671592 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e8acd6e4-8fa3-4b78-a9d7-4e55d50e5c96 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:44.675021 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e8acd6e4-8fa3-4b78-a9d7-4e55d50e5c96 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:44.690100 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8acd6e4-8fa3-4b78-a9d7-4e55d50e5c96 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:44.690848 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8acd6e4-8fa3-4b78-a9d7-4e55d50e5c96 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:44.692940 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8acd6e4-8fa3-4b78-a9d7-4e55d50e5c96 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:44.695012 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8acd6e4-8fa3-4b78-a9d7-4e55d50e5c96 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:44.978519 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e8acd6e4-8fa3-4b78-a9d7-4e55d50e5c96 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:44.998463 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e8acd6e4-8fa3-4b78-a9d7-4e55d50e5c96 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.329432 Jun 17 07:35:44.999606 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 99/202] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:44 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:45.195299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-da8b7aba-d3b5-46c4-bf68-7b9735a95990 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:45.203858 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-da8b7aba-d3b5-46c4-bf68-7b9735a95990 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.596328 Jun 17 07:35:45.205360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 104/203] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:44 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:45.614014 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-843c9e1a-7686-4356-b38a-08c5060a656c req-07ab5907-d8ff-440a-8180-7b78a5b02e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ad6743-cfda-46c3-afaa-6d54e2e80a2f", "tag": "1ce3a745-be88-4264-b1e5-51f76662590d"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:45.635388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-843c9e1a-7686-4356-b38a-08c5060a656c req-07ab5907-d8ff-440a-8180-7b78a5b02e0a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:45.645377 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-843c9e1a-7686-4356-b38a-08c5060a656c req-07ab5907-d8ff-440a-8180-7b78a5b02e0a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:45.692388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-843c9e1a-7686-4356-b38a-08c5060a656c req-07ab5907-d8ff-440a-8180-7b78a5b02e0a service nova] Creating event network-changed:1ce3a745-be88-4264-b1e5-51f76662590d for instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f on hv-cinder-79733 Jun 17 07:35:45.708118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-843c9e1a-7686-4356-b38a-08c5060a656c req-07ab5907-d8ff-440a-8180-7b78a5b02e0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097963 Jun 17 07:35:45.708723 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 100/204] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:35:46.018717 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-22b7a1ab-f6d6-417f-af94-ecb9d51ddded tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:46.020029 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-22b7a1ab-f6d6-417f-af94-ecb9d51ddded tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:46.045030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-22b7a1ab-f6d6-417f-af94-ecb9d51ddded tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:46.045030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-22b7a1ab-f6d6-417f-af94-ecb9d51ddded tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:46.049170 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-22b7a1ab-f6d6-417f-af94-ecb9d51ddded tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:46.050485 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-22b7a1ab-f6d6-417f-af94-ecb9d51ddded tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:46.223501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9a218944-9c73-4f48-a0eb-3110d819c7d6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:46.225091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9a218944-9c73-4f48-a0eb-3110d819c7d6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:46.239405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a218944-9c73-4f48-a0eb-3110d819c7d6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:46.241421 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a218944-9c73-4f48-a0eb-3110d819c7d6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:46.243191 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a218944-9c73-4f48-a0eb-3110d819c7d6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:46.243834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a218944-9c73-4f48-a0eb-3110d819c7d6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:46.399529 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-22b7a1ab-f6d6-417f-af94-ecb9d51ddded tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:46.409766 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-22b7a1ab-f6d6-417f-af94-ecb9d51ddded tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.395000 Jun 17 07:35:46.412282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 105/205] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:46 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:46.578501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9a218944-9c73-4f48-a0eb-3110d819c7d6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:46.595411 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9a218944-9c73-4f48-a0eb-3110d819c7d6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.375897 Jun 17 07:35:46.605296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 101/206] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:46 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:46.771204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4233ff11-32ee-428b-868f-b9d671d56024 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:46.772727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4233ff11-32ee-428b-868f-b9d671d56024 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:46.786526 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4233ff11-32ee-428b-868f-b9d671d56024 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:46.786846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4233ff11-32ee-428b-868f-b9d671d56024 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:46.789814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4233ff11-32ee-428b-868f-b9d671d56024 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:46.790341 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4233ff11-32ee-428b-868f-b9d671d56024 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:46.859846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4233ff11-32ee-428b-868f-b9d671d56024 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Going to try to terminate instance {{(pid=124472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:35:46.887570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:47.295402 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4233ff11-32ee-428b-868f-b9d671d56024 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 204 len: 0 microversion: 2.1 time: 0.527706 Jun 17 07:35:47.298451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 106/207] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:35:46 2022] DELETE /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:35:47.318744 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4a89c14d-9eab-4cb5-9a1d-a986556f6116 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:47.320652 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4a89c14d-9eab-4cb5-9a1d-a986556f6116 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:47.337400 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4a89c14d-9eab-4cb5-9a1d-a986556f6116 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:47.337400 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4a89c14d-9eab-4cb5-9a1d-a986556f6116 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:47.337985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4a89c14d-9eab-4cb5-9a1d-a986556f6116 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:47.338733 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4a89c14d-9eab-4cb5-9a1d-a986556f6116 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:47.430535 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0f1e29cd-acf9-4d36-b744-2399584738ab tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:47.431478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0f1e29cd-acf9-4d36-b744-2399584738ab tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:47.443635 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:47.451089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f1e29cd-acf9-4d36-b744-2399584738ab tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:47.451089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f1e29cd-acf9-4d36-b744-2399584738ab tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:47.451089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f1e29cd-acf9-4d36-b744-2399584738ab tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:47.451089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f1e29cd-acf9-4d36-b744-2399584738ab tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:47.531931 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4a89c14d-9eab-4cb5-9a1d-a986556f6116 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:47.540748 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4a89c14d-9eab-4cb5-9a1d-a986556f6116 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1550 microversion: 2.1 time: 0.230940 Jun 17 07:35:47.544855 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 102/208] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:47 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1550 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:47.612483 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-42e635fe-e5cb-491a-934a-eaa62cfa860a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:47.613087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-42e635fe-e5cb-491a-934a-eaa62cfa860a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:47.621044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42e635fe-e5cb-491a-934a-eaa62cfa860a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:47.625480 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42e635fe-e5cb-491a-934a-eaa62cfa860a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:47.626596 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42e635fe-e5cb-491a-934a-eaa62cfa860a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:47.627203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42e635fe-e5cb-491a-934a-eaa62cfa860a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:47.662600 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0f1e29cd-acf9-4d36-b744-2399584738ab tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:47.672778 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0f1e29cd-acf9-4d36-b744-2399584738ab tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.248075 Jun 17 07:35:47.673714 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 107/209] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:47 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:47.742260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:47.834476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-42e635fe-e5cb-491a-934a-eaa62cfa860a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:47.842339 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-42e635fe-e5cb-491a-934a-eaa62cfa860a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.233566 Jun 17 07:35:47.854751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 103/210] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:47 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:48.565019 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-89b515be-0531-4021-b9b4-2c864a34f2b0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:48.567023 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-89b515be-0531-4021-b9b4-2c864a34f2b0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:48.576035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89b515be-0531-4021-b9b4-2c864a34f2b0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:48.577481 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89b515be-0531-4021-b9b4-2c864a34f2b0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:48.580250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89b515be-0531-4021-b9b4-2c864a34f2b0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:48.581610 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89b515be-0531-4021-b9b4-2c864a34f2b0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:48.693132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-12fe93b9-dc91-4d87-ac1d-f55b75628cec tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:48.693775 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-12fe93b9-dc91-4d87-ac1d-f55b75628cec tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:48.704041 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-12fe93b9-dc91-4d87-ac1d-f55b75628cec tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:48.704469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-12fe93b9-dc91-4d87-ac1d-f55b75628cec tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:48.705256 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-12fe93b9-dc91-4d87-ac1d-f55b75628cec tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:48.705722 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-12fe93b9-dc91-4d87-ac1d-f55b75628cec tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:48.746168 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-89b515be-0531-4021-b9b4-2c864a34f2b0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:48.762870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-89b515be-0531-4021-b9b4-2c864a34f2b0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1550 microversion: 2.1 time: 0.204658 Jun 17 07:35:48.763466 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 108/211] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:48 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1550 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:48.858243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=8 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:48.866800 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-12fe93b9-dc91-4d87-ac1d-f55b75628cec tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:48.870071 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a27f47d8-d236-4a4e-83a3-260af398ca19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:48.870753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a27f47d8-d236-4a4e-83a3-260af398ca19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:48.876281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-12fe93b9-dc91-4d87-ac1d-f55b75628cec tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.187789 Jun 17 07:35:48.878353 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 104/212] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:48 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:48.881271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a27f47d8-d236-4a4e-83a3-260af398ca19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:48.881955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a27f47d8-d236-4a4e-83a3-260af398ca19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:48.882936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a27f47d8-d236-4a4e-83a3-260af398ca19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:48.883381 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a27f47d8-d236-4a4e-83a3-260af398ca19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:49.078416 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a27f47d8-d236-4a4e-83a3-260af398ca19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:49.089193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a27f47d8-d236-4a4e-83a3-260af398ca19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.230317 Jun 17 07:35:49.089193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 109/213] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:48 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:49.781080 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bd69ffd1-0cdb-4d81-9c0a-396e173414fc tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:49.782569 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bd69ffd1-0cdb-4d81-9c0a-396e173414fc tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:49.790906 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bd69ffd1-0cdb-4d81-9c0a-396e173414fc tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:49.791359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bd69ffd1-0cdb-4d81-9c0a-396e173414fc tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:49.792147 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bd69ffd1-0cdb-4d81-9c0a-396e173414fc tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:49.792795 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bd69ffd1-0cdb-4d81-9c0a-396e173414fc tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:49.897985 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3e9f8182-c97b-4d6f-a5fa-ce494e141dd2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:49.898609 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3e9f8182-c97b-4d6f-a5fa-ce494e141dd2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:49.905760 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e9f8182-c97b-4d6f-a5fa-ce494e141dd2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:49.906564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e9f8182-c97b-4d6f-a5fa-ce494e141dd2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:49.908690 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e9f8182-c97b-4d6f-a5fa-ce494e141dd2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:49.908690 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e9f8182-c97b-4d6f-a5fa-ce494e141dd2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:49.957499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-bd69ffd1-0cdb-4d81-9c0a-396e173414fc tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:49.966597 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bd69ffd1-0cdb-4d81-9c0a-396e173414fc tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1550 microversion: 2.1 time: 0.190148 Jun 17 07:35:49.967715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 105/214] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:49 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1550 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:50.105839 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d4189319-b618-4469-b5f9-f184fc5020de tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:50.106307 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d4189319-b618-4469-b5f9-f184fc5020de tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:50.112922 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d4189319-b618-4469-b5f9-f184fc5020de tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:50.114610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d4189319-b618-4469-b5f9-f184fc5020de tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:50.119855 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d4189319-b618-4469-b5f9-f184fc5020de tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:50.120009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3e9f8182-c97b-4d6f-a5fa-ce494e141dd2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:50.120145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d4189319-b618-4469-b5f9-f184fc5020de tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:50.128276 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3e9f8182-c97b-4d6f-a5fa-ce494e141dd2 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.239516 Jun 17 07:35:50.129280 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 110/215] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:49 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:50.315750 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d4189319-b618-4469-b5f9-f184fc5020de tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:50.326312 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d4189319-b618-4469-b5f9-f184fc5020de tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.224599 Jun 17 07:35:50.331604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 106/216] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:50 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:50.984040 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a3e0638a-a724-49d9-885a-87d07e2bb73b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:50.984645 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a3e0638a-a724-49d9-885a-87d07e2bb73b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:50.991380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3e0638a-a724-49d9-885a-87d07e2bb73b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:50.992139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3e0638a-a724-49d9-885a-87d07e2bb73b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:50.993027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3e0638a-a724-49d9-885a-87d07e2bb73b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:50.993493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3e0638a-a724-49d9-885a-87d07e2bb73b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:51.136829 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a3e0638a-a724-49d9-885a-87d07e2bb73b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:51.145966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0e84f8d4-d466-423e-8517-4c4543d1dc12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:51.146628 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a3e0638a-a724-49d9-885a-87d07e2bb73b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1550 microversion: 2.1 time: 0.166457 Jun 17 07:35:51.147059 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0e84f8d4-d466-423e-8517-4c4543d1dc12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:51.153588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0e84f8d4-d466-423e-8517-4c4543d1dc12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:51.167503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0e84f8d4-d466-423e-8517-4c4543d1dc12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:51.167503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0e84f8d4-d466-423e-8517-4c4543d1dc12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:51.167503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0e84f8d4-d466-423e-8517-4c4543d1dc12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:51.168061 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 111/217] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:50 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1550 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:51.298292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0e84f8d4-d466-423e-8517-4c4543d1dc12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:51.306036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0e84f8d4-d466-423e-8517-4c4543d1dc12 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.163774 Jun 17 07:35:51.306517 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 107/218] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:51 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:35:51.344099 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-977b6ddb-0fec-48dc-8cff-c2598b67c4ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:51.345307 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-977b6ddb-0fec-48dc-8cff-c2598b67c4ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:51.353284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-977b6ddb-0fec-48dc-8cff-c2598b67c4ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:51.353934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-977b6ddb-0fec-48dc-8cff-c2598b67c4ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:51.354844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-977b6ddb-0fec-48dc-8cff-c2598b67c4ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:51.355419 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-977b6ddb-0fec-48dc-8cff-c2598b67c4ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:51.532556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-977b6ddb-0fec-48dc-8cff-c2598b67c4ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:51.541582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-977b6ddb-0fec-48dc-8cff-c2598b67c4ae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.201366 Jun 17 07:35:51.542160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 112/219] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:51 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:52.164013 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4f4bb9fc-6051-4f02-8dcf-54297665ff04 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:52.164621 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4f4bb9fc-6051-4f02-8dcf-54297665ff04 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:52.171350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4f4bb9fc-6051-4f02-8dcf-54297665ff04 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:52.171790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4f4bb9fc-6051-4f02-8dcf-54297665ff04 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:52.172550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4f4bb9fc-6051-4f02-8dcf-54297665ff04 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:52.172978 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4f4bb9fc-6051-4f02-8dcf-54297665ff04 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:52.310080 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4f4bb9fc-6051-4f02-8dcf-54297665ff04 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:52.318120 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4f4bb9fc-6051-4f02-8dcf-54297665ff04 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1550 microversion: 2.1 time: 0.158659 Jun 17 07:35:52.318717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 108/220] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:52 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:52.325876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a8c50b22-d15c-47ea-b28d-b788a1fd3dc9 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:52.335552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a8c50b22-d15c-47ea-b28d-b788a1fd3dc9 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:52.335552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a8c50b22-d15c-47ea-b28d-b788a1fd3dc9 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:52.335552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a8c50b22-d15c-47ea-b28d-b788a1fd3dc9 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:52.336587 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a8c50b22-d15c-47ea-b28d-b788a1fd3dc9 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:52.336994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a8c50b22-d15c-47ea-b28d-b788a1fd3dc9 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:52.483600 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a8c50b22-d15c-47ea-b28d-b788a1fd3dc9 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:52.502409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a8c50b22-d15c-47ea-b28d-b788a1fd3dc9 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.181132 Jun 17 07:35:52.503723 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 113/221] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:52 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:52.558813 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-28fe8655-14d9-41fb-981e-c8ec708b4407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:52.559798 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-28fe8655-14d9-41fb-981e-c8ec708b4407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:52.572031 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-28fe8655-14d9-41fb-981e-c8ec708b4407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:52.572723 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-28fe8655-14d9-41fb-981e-c8ec708b4407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:52.573685 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-28fe8655-14d9-41fb-981e-c8ec708b4407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:52.574722 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-28fe8655-14d9-41fb-981e-c8ec708b4407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:52.607757 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:52.932748 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-28fe8655-14d9-41fb-981e-c8ec708b4407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:52.941385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-28fe8655-14d9-41fb-981e-c8ec708b4407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.385939 Jun 17 07:35:52.950665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 109/222] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:52 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:53.336596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a603f251-049e-4222-8ccf-631ee2f1fa11 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:53.337226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a603f251-049e-4222-8ccf-631ee2f1fa11 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:53.343726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a603f251-049e-4222-8ccf-631ee2f1fa11 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:53.344334 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a603f251-049e-4222-8ccf-631ee2f1fa11 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:53.345143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a603f251-049e-4222-8ccf-631ee2f1fa11 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:53.345684 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a603f251-049e-4222-8ccf-631ee2f1fa11 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:53.349716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-b220654c-956e-48c6-baba-1f32dcba198a req-bbc43863-0afb-474e-8076-728d062d4ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e997afb-9a72-40c0-8b38-871954558286", "name": "network-vif-deleted", "tag": "5366877e-faf9-4498-943a-cff8f23c175e"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:35:53.358961 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-b220654c-956e-48c6-baba-1f32dcba198a req-bbc43863-0afb-474e-8076-728d062d4ac1 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:53.359401 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-b220654c-956e-48c6-baba-1f32dcba198a req-bbc43863-0afb-474e-8076-728d062d4ac1 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:53.372199 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-b220654c-956e-48c6-baba-1f32dcba198a req-bbc43863-0afb-474e-8076-728d062d4ac1 service nova] Creating event network-vif-deleted:5366877e-faf9-4498-943a-cff8f23c175e for instance 4e997afb-9a72-40c0-8b38-871954558286 on hv-cinder-79733 Jun 17 07:35:53.379145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-b220654c-956e-48c6-baba-1f32dcba198a req-bbc43863-0afb-474e-8076-728d062d4ac1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033454 Jun 17 07:35:53.379761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 110/223] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:35:53.413123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a603f251-049e-4222-8ccf-631ee2f1fa11 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:53.421492 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a603f251-049e-4222-8ccf-631ee2f1fa11 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1508 microversion: 2.1 time: 0.089215 Jun 17 07:35:53.421862 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 114/224] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:53 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1508 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:53.520725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-60ea85fb-0655-4c10-9ea2-78b48babce58 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:53.521381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-60ea85fb-0655-4c10-9ea2-78b48babce58 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:53.527757 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60ea85fb-0655-4c10-9ea2-78b48babce58 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:53.528210 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60ea85fb-0655-4c10-9ea2-78b48babce58 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:53.528976 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60ea85fb-0655-4c10-9ea2-78b48babce58 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:53.529446 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60ea85fb-0655-4c10-9ea2-78b48babce58 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:53.669443 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-60ea85fb-0655-4c10-9ea2-78b48babce58 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:53.671740 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-60ea85fb-0655-4c10-9ea2-78b48babce58 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.155296 Jun 17 07:35:53.672324 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 111/225] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:53 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:53.960828 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d3aa788d-7f10-4bc3-9300-fd06a3776607 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:53.961519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d3aa788d-7f10-4bc3-9300-fd06a3776607 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:53.967553 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d3aa788d-7f10-4bc3-9300-fd06a3776607 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:53.967995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d3aa788d-7f10-4bc3-9300-fd06a3776607 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:53.968754 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d3aa788d-7f10-4bc3-9300-fd06a3776607 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:53.969180 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d3aa788d-7f10-4bc3-9300-fd06a3776607 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:54.099465 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d3aa788d-7f10-4bc3-9300-fd06a3776607 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:54.107638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d3aa788d-7f10-4bc3-9300-fd06a3776607 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.151427 Jun 17 07:35:54.108211 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 115/226] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:53 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:54.438884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-07c1b228-7885-4b4f-8724-2ee3ea6b23c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:54.439487 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-07c1b228-7885-4b4f-8724-2ee3ea6b23c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:54.446740 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-07c1b228-7885-4b4f-8724-2ee3ea6b23c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:54.447178 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-07c1b228-7885-4b4f-8724-2ee3ea6b23c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:54.447932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-07c1b228-7885-4b4f-8724-2ee3ea6b23c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:54.448359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-07c1b228-7885-4b4f-8724-2ee3ea6b23c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:54.512136 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-07c1b228-7885-4b4f-8724-2ee3ea6b23c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:54.520927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-07c1b228-7885-4b4f-8724-2ee3ea6b23c0 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1508 microversion: 2.1 time: 0.084992 Jun 17 07:35:54.520927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 112/227] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:54 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1508 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:54.693469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3651d3ea-9389-4ddd-b249-acd2fba1bbf3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:54.694284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3651d3ea-9389-4ddd-b249-acd2fba1bbf3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:54.700852 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3651d3ea-9389-4ddd-b249-acd2fba1bbf3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:54.700852 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3651d3ea-9389-4ddd-b249-acd2fba1bbf3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:54.701666 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3651d3ea-9389-4ddd-b249-acd2fba1bbf3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:54.702094 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3651d3ea-9389-4ddd-b249-acd2fba1bbf3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:54.827943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3651d3ea-9389-4ddd-b249-acd2fba1bbf3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:54.835788 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3651d3ea-9389-4ddd-b249-acd2fba1bbf3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.146244 Jun 17 07:35:54.836352 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 116/228] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:54 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:55.124952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f0aa45af-78e2-432c-af1b-3a57957d9a47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:55.125575 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f0aa45af-78e2-432c-af1b-3a57957d9a47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:55.132217 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f0aa45af-78e2-432c-af1b-3a57957d9a47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:55.132845 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f0aa45af-78e2-432c-af1b-3a57957d9a47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:55.133629 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f0aa45af-78e2-432c-af1b-3a57957d9a47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:55.134064 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f0aa45af-78e2-432c-af1b-3a57957d9a47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:55.266051 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f0aa45af-78e2-432c-af1b-3a57957d9a47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:55.275034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f0aa45af-78e2-432c-af1b-3a57957d9a47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.154113 Jun 17 07:35:55.275618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 113/229] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:55 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:55.536831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a929e3ea-2699-411d-9975-0205c1386ce8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:55.537459 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a929e3ea-2699-411d-9975-0205c1386ce8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:55.543310 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a929e3ea-2699-411d-9975-0205c1386ce8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:55.543750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a929e3ea-2699-411d-9975-0205c1386ce8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:55.544498 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a929e3ea-2699-411d-9975-0205c1386ce8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:55.544919 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a929e3ea-2699-411d-9975-0205c1386ce8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:55.607026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a929e3ea-2699-411d-9975-0205c1386ce8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:55.615358 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a929e3ea-2699-411d-9975-0205c1386ce8 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1508 microversion: 2.1 time: 0.082349 Jun 17 07:35:55.616587 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 117/230] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:55 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1508 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:55.853195 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-834a9874-5836-4a41-a95c-03f8d0744098 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:55.853826 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-834a9874-5836-4a41-a95c-03f8d0744098 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:55.860238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-834a9874-5836-4a41-a95c-03f8d0744098 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:55.860695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-834a9874-5836-4a41-a95c-03f8d0744098 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:55.861473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-834a9874-5836-4a41-a95c-03f8d0744098 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:55.861900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-834a9874-5836-4a41-a95c-03f8d0744098 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:55.990341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-834a9874-5836-4a41-a95c-03f8d0744098 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:55.998668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-834a9874-5836-4a41-a95c-03f8d0744098 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.150079 Jun 17 07:35:55.999248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 114/231] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:55 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:56.292660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d52b4048-dc83-46d4-8491-0b8ab95359fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:56.293265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d52b4048-dc83-46d4-8491-0b8ab95359fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:56.299509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d52b4048-dc83-46d4-8491-0b8ab95359fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:56.299943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d52b4048-dc83-46d4-8491-0b8ab95359fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:56.300699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d52b4048-dc83-46d4-8491-0b8ab95359fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:56.301122 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d52b4048-dc83-46d4-8491-0b8ab95359fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:56.433677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d52b4048-dc83-46d4-8491-0b8ab95359fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:56.441066 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d52b4048-dc83-46d4-8491-0b8ab95359fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.152365 Jun 17 07:35:56.441656 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 118/232] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:56 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:56.633445 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b7ef9aa7-4565-4301-bc78-d89ae6d569f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:56.634104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b7ef9aa7-4565-4301-bc78-d89ae6d569f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:56.640455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7ef9aa7-4565-4301-bc78-d89ae6d569f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:56.641000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7ef9aa7-4565-4301-bc78-d89ae6d569f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:56.641788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7ef9aa7-4565-4301-bc78-d89ae6d569f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:56.642212 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7ef9aa7-4565-4301-bc78-d89ae6d569f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:56.707207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b7ef9aa7-4565-4301-bc78-d89ae6d569f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:56.715470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b7ef9aa7-4565-4301-bc78-d89ae6d569f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1508 microversion: 2.1 time: 0.085901 Jun 17 07:35:56.716045 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 115/233] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:56 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1508 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:57.015562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-98528b1b-9d3e-4e82-ade3-a6a89ed61700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:57.016219 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-98528b1b-9d3e-4e82-ade3-a6a89ed61700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:57.022756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-98528b1b-9d3e-4e82-ade3-a6a89ed61700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:57.023193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-98528b1b-9d3e-4e82-ade3-a6a89ed61700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:57.023934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-98528b1b-9d3e-4e82-ade3-a6a89ed61700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:57.024376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-98528b1b-9d3e-4e82-ade3-a6a89ed61700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:57.152070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-98528b1b-9d3e-4e82-ade3-a6a89ed61700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:57.159415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-98528b1b-9d3e-4e82-ade3-a6a89ed61700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.147684 Jun 17 07:35:57.159976 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:57 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:57.458784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fc67d549-883b-4cad-96ea-6b5c1d5da57b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:57.459410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fc67d549-883b-4cad-96ea-6b5c1d5da57b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:57.465965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc67d549-883b-4cad-96ea-6b5c1d5da57b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:57.466402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc67d549-883b-4cad-96ea-6b5c1d5da57b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:57.467158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc67d549-883b-4cad-96ea-6b5c1d5da57b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:57.467587 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc67d549-883b-4cad-96ea-6b5c1d5da57b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:57.596689 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fc67d549-883b-4cad-96ea-6b5c1d5da57b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:57.605269 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fc67d549-883b-4cad-96ea-6b5c1d5da57b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.150288 Jun 17 07:35:57.606294 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 116/235] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:57 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:57.732719 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-61f3e125-2b5f-4d13-8521-1a018b0f232c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:57.733364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-61f3e125-2b5f-4d13-8521-1a018b0f232c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:57.739662 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-61f3e125-2b5f-4d13-8521-1a018b0f232c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:57.740107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-61f3e125-2b5f-4d13-8521-1a018b0f232c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:57.740898 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-61f3e125-2b5f-4d13-8521-1a018b0f232c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:57.741452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-61f3e125-2b5f-4d13-8521-1a018b0f232c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:57.811674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-61f3e125-2b5f-4d13-8521-1a018b0f232c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:57.825946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-61f3e125-2b5f-4d13-8521-1a018b0f232c tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1344 microversion: 2.1 time: 0.096963 Jun 17 07:35:57.829139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 120/236] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:57 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:58.177691 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d7f99024-445c-48a8-b800-eb6350a21d0a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:58.178473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d7f99024-445c-48a8-b800-eb6350a21d0a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:58.185190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7f99024-445c-48a8-b800-eb6350a21d0a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:58.185665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7f99024-445c-48a8-b800-eb6350a21d0a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:58.186430 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7f99024-445c-48a8-b800-eb6350a21d0a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:58.186927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7f99024-445c-48a8-b800-eb6350a21d0a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:58.328840 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d7f99024-445c-48a8-b800-eb6350a21d0a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:58.337900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d7f99024-445c-48a8-b800-eb6350a21d0a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.164269 Jun 17 07:35:58.338522 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 117/237] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:58 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:58.623791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-be572961-0081-4a4d-adc0-c6b787c51c47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:58.624375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-be572961-0081-4a4d-adc0-c6b787c51c47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:58.630755 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-be572961-0081-4a4d-adc0-c6b787c51c47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:58.631846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-be572961-0081-4a4d-adc0-c6b787c51c47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:58.632767 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-be572961-0081-4a4d-adc0-c6b787c51c47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:58.633192 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-be572961-0081-4a4d-adc0-c6b787c51c47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:58.846222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4ba6adda-2c56-4995-8cee-b667bcc9d35a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:58.847719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4ba6adda-2c56-4995-8cee-b667bcc9d35a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:58.855517 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4ba6adda-2c56-4995-8cee-b667bcc9d35a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:58.855972 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4ba6adda-2c56-4995-8cee-b667bcc9d35a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:58.856758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4ba6adda-2c56-4995-8cee-b667bcc9d35a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:58.857195 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4ba6adda-2c56-4995-8cee-b667bcc9d35a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:58.928607 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4ba6adda-2c56-4995-8cee-b667bcc9d35a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:58.939434 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4ba6adda-2c56-4995-8cee-b667bcc9d35a tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1344 microversion: 2.1 time: 0.095682 Jun 17 07:35:58.939434 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 118/238] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:58 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:58.974796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-be572961-0081-4a4d-adc0-c6b787c51c47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:58.980362 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-be572961-0081-4a4d-adc0-c6b787c51c47 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.361100 Jun 17 07:35:58.980962 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 121/239] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:58 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:59.355717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bdebf35e-055b-48aa-b4c7-84292e6d35b0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:59.356328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bdebf35e-055b-48aa-b4c7-84292e6d35b0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:59.362570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bdebf35e-055b-48aa-b4c7-84292e6d35b0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:59.363044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bdebf35e-055b-48aa-b4c7-84292e6d35b0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:59.363806 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bdebf35e-055b-48aa-b4c7-84292e6d35b0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:59.364253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bdebf35e-055b-48aa-b4c7-84292e6d35b0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:59.519808 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-bdebf35e-055b-48aa-b4c7-84292e6d35b0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:35:59.529722 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bdebf35e-055b-48aa-b4c7-84292e6d35b0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.177508 Jun 17 07:35:59.533737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 119/240] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:59 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:35:59.955037 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5f882563-cce2-46bd-86ae-51af7fa8dd17 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:59.955680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5f882563-cce2-46bd-86ae-51af7fa8dd17 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:35:59.962542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5f882563-cce2-46bd-86ae-51af7fa8dd17 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:59.962993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5f882563-cce2-46bd-86ae-51af7fa8dd17 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:59.963753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5f882563-cce2-46bd-86ae-51af7fa8dd17 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:35:59.964189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5f882563-cce2-46bd-86ae-51af7fa8dd17 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:35:59.968295 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:35:59.998284 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7ea439bd-7171-4b98-a384-7f9d654e2303 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:35:59.999203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7ea439bd-7171-4b98-a384-7f9d654e2303 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:00.006194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ea439bd-7171-4b98-a384-7f9d654e2303 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:00.006881 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ea439bd-7171-4b98-a384-7f9d654e2303 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:00.009385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ea439bd-7171-4b98-a384-7f9d654e2303 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:00.009385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ea439bd-7171-4b98-a384-7f9d654e2303 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:00.028911 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5f882563-cce2-46bd-86ae-51af7fa8dd17 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:00.036517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5f882563-cce2-46bd-86ae-51af7fa8dd17 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1344 microversion: 2.1 time: 0.085274 Jun 17 07:36:00.037390 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 122/241] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:59 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:00.155626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7ea439bd-7171-4b98-a384-7f9d654e2303 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:00.163302 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7ea439bd-7171-4b98-a384-7f9d654e2303 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.169646 Jun 17 07:36:00.163893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 120/242] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:35:59 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:00.547971 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cbc79716-844f-4d61-9486-e5ce1629005d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:00.548613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cbc79716-844f-4d61-9486-e5ce1629005d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:00.555202 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cbc79716-844f-4d61-9486-e5ce1629005d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:00.555648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cbc79716-844f-4d61-9486-e5ce1629005d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:00.556407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cbc79716-844f-4d61-9486-e5ce1629005d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:00.556839 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cbc79716-844f-4d61-9486-e5ce1629005d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:00.823460 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cbc79716-844f-4d61-9486-e5ce1629005d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:00.832037 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cbc79716-844f-4d61-9486-e5ce1629005d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.288326 Jun 17 07:36:00.832811 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 123/243] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:00 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:01.054365 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b7e32f7d-65f9-4d0a-b67a-286ec9dd7783 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:01.054965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b7e32f7d-65f9-4d0a-b67a-286ec9dd7783 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:01.061840 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7e32f7d-65f9-4d0a-b67a-286ec9dd7783 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:01.062287 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7e32f7d-65f9-4d0a-b67a-286ec9dd7783 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:01.063056 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7e32f7d-65f9-4d0a-b67a-286ec9dd7783 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:01.063516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7e32f7d-65f9-4d0a-b67a-286ec9dd7783 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:01.181056 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2561b716-07c8-45ee-b646-652ee102ac31 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:01.181743 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2561b716-07c8-45ee-b646-652ee102ac31 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:01.188362 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2561b716-07c8-45ee-b646-652ee102ac31 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:01.188677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2561b716-07c8-45ee-b646-652ee102ac31 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:01.189493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2561b716-07c8-45ee-b646-652ee102ac31 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:01.189925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2561b716-07c8-45ee-b646-652ee102ac31 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:01.271220 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b7e32f7d-65f9-4d0a-b67a-286ec9dd7783 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:01.282491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b7e32f7d-65f9-4d0a-b67a-286ec9dd7783 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1344 microversion: 2.1 time: 0.232406 Jun 17 07:36:01.285016 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 121/244] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:01 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1344 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:01.337386 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2561b716-07c8-45ee-b646-652ee102ac31 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:01.345882 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2561b716-07c8-45ee-b646-652ee102ac31 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.169428 Jun 17 07:36:01.346455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 124/245] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:01 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:01.849702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f56136de-5026-4f99-bb2d-0bb26f7d663c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:01.850401 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f56136de-5026-4f99-bb2d-0bb26f7d663c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:01.857613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f56136de-5026-4f99-bb2d-0bb26f7d663c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:01.858712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f56136de-5026-4f99-bb2d-0bb26f7d663c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:01.858883 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f56136de-5026-4f99-bb2d-0bb26f7d663c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:01.859830 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f56136de-5026-4f99-bb2d-0bb26f7d663c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:02.002237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f56136de-5026-4f99-bb2d-0bb26f7d663c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:02.010978 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f56136de-5026-4f99-bb2d-0bb26f7d663c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.165237 Jun 17 07:36:02.011557 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 122/246] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:01 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:02.300790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b33b01da-2c6c-4ab8-b0f3-1d6492030b66 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:02.301611 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b33b01da-2c6c-4ab8-b0f3-1d6492030b66 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:02.309002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b33b01da-2c6c-4ab8-b0f3-1d6492030b66 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:02.309624 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b33b01da-2c6c-4ab8-b0f3-1d6492030b66 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:02.310819 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b33b01da-2c6c-4ab8-b0f3-1d6492030b66 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:02.311306 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b33b01da-2c6c-4ab8-b0f3-1d6492030b66 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:02.363371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e8bcd543-8351-4aea-9884-4d8572b9fe44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:02.363979 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e8bcd543-8351-4aea-9884-4d8572b9fe44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:02.367481 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=80 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:02.372795 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8bcd543-8351-4aea-9884-4d8572b9fe44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:02.373241 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8bcd543-8351-4aea-9884-4d8572b9fe44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:02.375199 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8bcd543-8351-4aea-9884-4d8572b9fe44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:02.375199 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8bcd543-8351-4aea-9884-4d8572b9fe44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:02.376637 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b33b01da-2c6c-4ab8-b0f3-1d6492030b66 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:02.386644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b33b01da-2c6c-4ab8-b0f3-1d6492030b66 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1344 microversion: 2.1 time: 0.090602 Jun 17 07:36:02.387226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 125/247] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:02 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:02.511945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e8bcd543-8351-4aea-9884-4d8572b9fe44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:02.519486 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e8bcd543-8351-4aea-9884-4d8572b9fe44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.159959 Jun 17 07:36:02.520064 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 123/248] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:02 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:02.961282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-29fc8152-5f82-4ecc-a1f6-12ad79cb7e14 req-f25d9981-e833-49d6-b1d5-d99c3e560353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead8bc69-fb51-4feb-a5aa-893812890c54", "name": "network-vif-plugged", "status": "completed", "tag": "eb2093c5-84bc-4bb1-ba58-833eb8ee39a3"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:36:02.970017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-29fc8152-5f82-4ecc-a1f6-12ad79cb7e14 req-f25d9981-e833-49d6-b1d5-d99c3e560353 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:02.970467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-29fc8152-5f82-4ecc-a1f6-12ad79cb7e14 req-f25d9981-e833-49d6-b1d5-d99c3e560353 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:02.986074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-29fc8152-5f82-4ecc-a1f6-12ad79cb7e14 req-f25d9981-e833-49d6-b1d5-d99c3e560353 service nova] Creating event network-vif-plugged:eb2093c5-84bc-4bb1-ba58-833eb8ee39a3 for instance ead8bc69-fb51-4feb-a5aa-893812890c54 on hv-cinder-79733 Jun 17 07:36:02.992578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-29fc8152-5f82-4ecc-a1f6-12ad79cb7e14 req-f25d9981-e833-49d6-b1d5-d99c3e560353 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035459 Jun 17 07:36:02.993189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 126/249] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:36:03.029276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-03ab6c13-f8e7-4fbe-aa78-1823a4d7034d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:03.029917 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-03ab6c13-f8e7-4fbe-aa78-1823a4d7034d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:03.035973 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ab6c13-f8e7-4fbe-aa78-1823a4d7034d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:03.036464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ab6c13-f8e7-4fbe-aa78-1823a4d7034d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:03.037166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ab6c13-f8e7-4fbe-aa78-1823a4d7034d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:03.038398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ab6c13-f8e7-4fbe-aa78-1823a4d7034d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:03.188932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-03ab6c13-f8e7-4fbe-aa78-1823a4d7034d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:03.197529 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-03ab6c13-f8e7-4fbe-aa78-1823a4d7034d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.172052 Jun 17 07:36:03.198121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 124/250] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:03 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:03.404732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5337c816-29e4-468b-b0ec-50ddf235d4f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:03.405458 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5337c816-29e4-468b-b0ec-50ddf235d4f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:03.407613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:03.412579 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5337c816-29e4-468b-b0ec-50ddf235d4f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:03.413026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5337c816-29e4-468b-b0ec-50ddf235d4f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:03.413831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5337c816-29e4-468b-b0ec-50ddf235d4f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:03.414269 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5337c816-29e4-468b-b0ec-50ddf235d4f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:03.483491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5337c816-29e4-468b-b0ec-50ddf235d4f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:03.492188 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5337c816-29e4-468b-b0ec-50ddf235d4f7 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1344 microversion: 2.1 time: 0.091613 Jun 17 07:36:03.492763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 127/251] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:03 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:03.536760 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1486fbea-1d6b-4c3b-8a0c-fd159c4a94f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:03.537948 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1486fbea-1d6b-4c3b-8a0c-fd159c4a94f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:03.544500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1486fbea-1d6b-4c3b-8a0c-fd159c4a94f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:03.544937 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1486fbea-1d6b-4c3b-8a0c-fd159c4a94f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:03.559457 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1486fbea-1d6b-4c3b-8a0c-fd159c4a94f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:03.559457 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1486fbea-1d6b-4c3b-8a0c-fd159c4a94f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:03.701792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1486fbea-1d6b-4c3b-8a0c-fd159c4a94f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:03.710001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1486fbea-1d6b-4c3b-8a0c-fd159c4a94f0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.176348 Jun 17 07:36:03.710651 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 125/252] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:03 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:04.216307 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-55cc0492-856b-4b82-987e-4a0cf309ed95 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:04.216919 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-55cc0492-856b-4b82-987e-4a0cf309ed95 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:04.223165 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-55cc0492-856b-4b82-987e-4a0cf309ed95 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:04.223606 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-55cc0492-856b-4b82-987e-4a0cf309ed95 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:04.224365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-55cc0492-856b-4b82-987e-4a0cf309ed95 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:04.224797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-55cc0492-856b-4b82-987e-4a0cf309ed95 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:04.364768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-55cc0492-856b-4b82-987e-4a0cf309ed95 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:04.372403 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-55cc0492-856b-4b82-987e-4a0cf309ed95 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.160118 Jun 17 07:36:04.372968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 128/253] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:04 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:04.510462 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f33d2df9-1a12-4b58-aea5-8c3e0a90f258 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:04.511065 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f33d2df9-1a12-4b58-aea5-8c3e0a90f258 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:04.517161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f33d2df9-1a12-4b58-aea5-8c3e0a90f258 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:04.517765 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f33d2df9-1a12-4b58-aea5-8c3e0a90f258 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:04.518534 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f33d2df9-1a12-4b58-aea5-8c3e0a90f258 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:04.518951 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f33d2df9-1a12-4b58-aea5-8c3e0a90f258 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:04.593263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f33d2df9-1a12-4b58-aea5-8c3e0a90f258 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:04.598061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:04.605651 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f33d2df9-1a12-4b58-aea5-8c3e0a90f258 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1344 microversion: 2.1 time: 0.100133 Jun 17 07:36:04.607202 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 126/254] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:04 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:04.726879 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0e33e28d-f0ba-4544-a71e-5da8bca9bea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:04.727480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0e33e28d-f0ba-4544-a71e-5da8bca9bea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:04.733530 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e33e28d-f0ba-4544-a71e-5da8bca9bea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:04.733966 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e33e28d-f0ba-4544-a71e-5da8bca9bea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:04.734714 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e33e28d-f0ba-4544-a71e-5da8bca9bea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:04.735141 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e33e28d-f0ba-4544-a71e-5da8bca9bea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:04.911954 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0e33e28d-f0ba-4544-a71e-5da8bca9bea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:04.913272 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0e33e28d-f0ba-4544-a71e-5da8bca9bea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.189723 Jun 17 07:36:04.925436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 129/255] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:04 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:05.390195 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6432f10e-96f8-4d40-ae4c-ee9866400f1f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:05.390797 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6432f10e-96f8-4d40-ae4c-ee9866400f1f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:05.398459 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6432f10e-96f8-4d40-ae4c-ee9866400f1f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:05.398907 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6432f10e-96f8-4d40-ae4c-ee9866400f1f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:05.399660 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6432f10e-96f8-4d40-ae4c-ee9866400f1f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:05.400091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6432f10e-96f8-4d40-ae4c-ee9866400f1f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:05.539893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6432f10e-96f8-4d40-ae4c-ee9866400f1f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:05.547305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6432f10e-96f8-4d40-ae4c-ee9866400f1f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1318 microversion: 2.1 time: 0.161292 Jun 17 07:36:05.547872 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 127/256] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:05 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:05.624423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:05.625605 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:05.632710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:05.639973 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:05.639973 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:05.639973 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:05.669429 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:05.669886 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:05.670338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lazy-loading 'fault' on Instance uuid 4e997afb-9a72-40c0-8b38-871954558286 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:36:05.722288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7b9aa8532b47afafeb7481932bfce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d57351560654accb09e975bbc8dcf17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:05.732067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1936e082-50ac-4636-9373-c18a3ec009b9 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 200 len: 1349 microversion: 2.1 time: 0.111847 Jun 17 07:36:05.732752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 130/257] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:05 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 1349 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:05.933150 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e79c0678-67ea-4b4d-abdc-1c153516d471 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:05.933150 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e79c0678-67ea-4b4d-abdc-1c153516d471 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:05.938934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e79c0678-67ea-4b4d-abdc-1c153516d471 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:05.939471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e79c0678-67ea-4b4d-abdc-1c153516d471 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:05.940314 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e79c0678-67ea-4b4d-abdc-1c153516d471 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:05.940741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e79c0678-67ea-4b4d-abdc-1c153516d471 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:06.106690 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e79c0678-67ea-4b4d-abdc-1c153516d471 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:06.118696 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e79c0678-67ea-4b4d-abdc-1c153516d471 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.191572 Jun 17 07:36:06.119285 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 128/258] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:05 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:06.564201 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ae668029-b149-4726-a7ea-a3b2d155952e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:06.565590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ae668029-b149-4726-a7ea-a3b2d155952e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:06.572217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae668029-b149-4726-a7ea-a3b2d155952e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:06.572670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae668029-b149-4726-a7ea-a3b2d155952e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:06.573510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae668029-b149-4726-a7ea-a3b2d155952e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:06.574041 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae668029-b149-4726-a7ea-a3b2d155952e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:06.717946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ae668029-b149-4726-a7ea-a3b2d155952e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:06.726584 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ae668029-b149-4726-a7ea-a3b2d155952e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1508 microversion: 2.1 time: 0.166353 Jun 17 07:36:06.727355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 131/259] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:06 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:06.754968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:06.756234 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:06.763951 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:06.765075 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:06.766358 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:06.766927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:06.785889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] HTTP exception thrown: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Request method failure captured: Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 HTTP/1.1 Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC6IafLJkHSemdowny8sgpXIVeBtI1wT0LTdEzgIiv0jEfhnpWctYyLV_aZucv1FT23YYuszBhAk54IUafd1tbbhlbpXGf47Tj5lcigBM2ZPPwPf-xDdn918t4Hd8nCBAYG8BcERrmslT9ursHQhfKqshbsqJ5J4Q6tgkjrgBukQXUI Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 1d57351560654accb09e975bbc8dcf17 Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:36:06.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d57351560654accb09e975bbc8dcf17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 1d57351560654accb09e975bbc8dcf17 Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-DeleteServersTestJSON-881219301-project Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3e7b9aa8532b47afafeb7481932bfce9 Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-DeleteServersTestJSON-881219301-project Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:06.794356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '4e997afb-9a72-40c0-8b38-871954558286'} Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:36:06.795753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:06.799809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:06.803947 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Returning 404 to user: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:36:06.803947 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-692ad5c5-e94e-4380-bcd3-63ab895e9f1b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 404 len: 111 microversion: 2.1 time: 0.045823 Jun 17 07:36:06.803947 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 129/260] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:06 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:36:06.970852 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:06.981175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:06.981175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:06.981175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:06.981175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:06.982751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:06.994439 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] HTTP exception thrown: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Request method failure captured: Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286/os-volume_attachments HTTP/1.1 Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6IafLJkHSemdowny8sgpXIVeBtI1wT0LTdEzgIiv0jEfhnpWctYyLV_aZucv1FT23YYuszBhAk54IUafd1tbbhlbpXGf47Tj5lcigBM2ZPPwPf-xDdn918t4Hd8nCBAYG8BcERrmslT9ursHQhfKqshbsqJ5J4Q6tgkjrgBukQXUI Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 1d57351560654accb09e975bbc8dcf17 Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:36:06.999264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d57351560654accb09e975bbc8dcf17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 1d57351560654accb09e975bbc8dcf17 Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-DeleteServersTestJSON-881219301-project Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3e7b9aa8532b47afafeb7481932bfce9 Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-DeleteServersTestJSON-881219301-project Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:07.000713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'server_id': '4e997afb-9a72-40c0-8b38-871954558286'} Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:36:07.001548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:07.002765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:07.004233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Returning 404 to user: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:36:07.004233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-05c7065c-a7cf-441e-acce-ea83843b9e4b tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033883 Jun 17 07:36:07.004806 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 132/261] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:36:06 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:36:07.139343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-77d6c54b-22a1-4d2b-9238-b74297e17d75 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:07.140117 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-77d6c54b-22a1-4d2b-9238-b74297e17d75 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:07.147972 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77d6c54b-22a1-4d2b-9238-b74297e17d75 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:07.150695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77d6c54b-22a1-4d2b-9238-b74297e17d75 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:07.150695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77d6c54b-22a1-4d2b-9238-b74297e17d75 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:07.150695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77d6c54b-22a1-4d2b-9238-b74297e17d75 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:07.291719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-77d6c54b-22a1-4d2b-9238-b74297e17d75 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:07.311678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-77d6c54b-22a1-4d2b-9238-b74297e17d75 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.164598 Jun 17 07:36:07.311678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 130/262] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:07 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:08.320057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3b5fe614-db3d-4292-a3ee-d57e1070bcd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:08.321265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3b5fe614-db3d-4292-a3ee-d57e1070bcd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:08.349548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b5fe614-db3d-4292-a3ee-d57e1070bcd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:08.350573 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b5fe614-db3d-4292-a3ee-d57e1070bcd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:08.354172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b5fe614-db3d-4292-a3ee-d57e1070bcd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:08.356502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b5fe614-db3d-4292-a3ee-d57e1070bcd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:08.628884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:08.629917 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3b5fe614-db3d-4292-a3ee-d57e1070bcd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:08.630179 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:08.638315 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:08.639272 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:08.640546 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:08.641403 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:08.642391 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3b5fe614-db3d-4292-a3ee-d57e1070bcd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.327852 Jun 17 07:36:08.644179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 133/263] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:08 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:08.663123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] HTTP exception thrown: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Request method failure captured: Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: DELETE /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 HTTP/1.1 Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC6IafLJkHSemdowny8sgpXIVeBtI1wT0LTdEzgIiv0jEfhnpWctYyLV_aZucv1FT23YYuszBhAk54IUafd1tbbhlbpXGf47Tj5lcigBM2ZPPwPf-xDdn918t4Hd8nCBAYG8BcERrmslT9ursHQhfKqshbsqJ5J4Q6tgkjrgBukQXUI Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 1d57351560654accb09e975bbc8dcf17 Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:36:08.675437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d57351560654accb09e975bbc8dcf17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 1d57351560654accb09e975bbc8dcf17 Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-DeleteServersTestJSON-881219301-project Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3e7b9aa8532b47afafeb7481932bfce9 Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-DeleteServersTestJSON-881219301-project Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.677039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '4e997afb-9a72-40c0-8b38-871954558286'} Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:36:08.678644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.680073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.681156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Returning 404 to user: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:36:08.681156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9d95f7db-ad90-4195-8864-d77ee959a8a1 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 404 len: 111 microversion: 2.1 time: 0.046347 Jun 17 07:36:08.681156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 131/264] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:36:08 2022] DELETE /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:36:08.685022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:08.685022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] [instance: 4e997afb-9a72-40c0-8b38-871954558286] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:08.694422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:08.695960 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:08.696292 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:08.705710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:08.729433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] HTTP exception thrown: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Request method failure captured: Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 HTTP/1.1 Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6IafLJkHSemdowny8sgpXIVeBtI1wT0LTdEzgIiv0jEfhnpWctYyLV_aZucv1FT23YYuszBhAk54IUafd1tbbhlbpXGf47Tj5lcigBM2ZPPwPf-xDdn918t4Hd8nCBAYG8BcERrmslT9ursHQhfKqshbsqJ5J4Q6tgkjrgBukQXUI Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 1d57351560654accb09e975bbc8dcf17 Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:36:08.731915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d57351560654accb09e975bbc8dcf17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d57351560654accb09e975bbc8dcf17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 1d57351560654accb09e975bbc8dcf17 Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-DeleteServersTestJSON-881219301 Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-DeleteServersTestJSON-881219301-project Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3e7b9aa8532b47afafeb7481932bfce9 Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-DeleteServersTestJSON-881219301-project Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.733138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '4e997afb-9a72-40c0-8b38-871954558286'} Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:36:08.733921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. Jun 17 07:36:08.735067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:36:08.737617 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] Returning 404 to user: Instance 4e997afb-9a72-40c0-8b38-871954558286 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:36:08.738674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6003e71f-6b9f-4011-b4f0-dceee878e9c2 tempest-DeleteServersTestJSON-881219301 tempest-DeleteServersTestJSON-881219301-project] 10.222.0.52 "GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286" status: 404 len: 111 microversion: 2.1 time: 0.061848 Jun 17 07:36:08.744052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 134/265] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:08 2022] GET /compute/v2.1/servers/4e997afb-9a72-40c0-8b38-871954558286 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:36:09.663922 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-611c2536-357e-4e04-9432-8802ff57a82c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:09.667063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-611c2536-357e-4e04-9432-8802ff57a82c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:09.689581 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-611c2536-357e-4e04-9432-8802ff57a82c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:09.690051 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-611c2536-357e-4e04-9432-8802ff57a82c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:09.690914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-611c2536-357e-4e04-9432-8802ff57a82c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:09.692513 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-611c2536-357e-4e04-9432-8802ff57a82c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:09.989618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-611c2536-357e-4e04-9432-8802ff57a82c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:09.998761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-611c2536-357e-4e04-9432-8802ff57a82c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.341652 Jun 17 07:36:09.998981 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 132/266] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:09 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:11.015290 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1cac21bf-53cb-496f-9958-4d0743376a93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:11.016509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1cac21bf-53cb-496f-9958-4d0743376a93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:11.025895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1cac21bf-53cb-496f-9958-4d0743376a93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:11.026605 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1cac21bf-53cb-496f-9958-4d0743376a93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:11.027572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1cac21bf-53cb-496f-9958-4d0743376a93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:11.028189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1cac21bf-53cb-496f-9958-4d0743376a93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:11.300804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1cac21bf-53cb-496f-9958-4d0743376a93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:11.313364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1cac21bf-53cb-496f-9958-4d0743376a93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1521 microversion: 2.1 time: 0.301817 Jun 17 07:36:11.324566 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 135/267] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:11 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:12.340853 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a5cdb795-ac62-4bbe-9db0-c11a3fb19253 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:12.342613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a5cdb795-ac62-4bbe-9db0-c11a3fb19253 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:12.352505 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5cdb795-ac62-4bbe-9db0-c11a3fb19253 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:12.354252 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5cdb795-ac62-4bbe-9db0-c11a3fb19253 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:12.357981 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5cdb795-ac62-4bbe-9db0-c11a3fb19253 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:12.358608 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5cdb795-ac62-4bbe-9db0-c11a3fb19253 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:12.736985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a5cdb795-ac62-4bbe-9db0-c11a3fb19253 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:12.777882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a5cdb795-ac62-4bbe-9db0-c11a3fb19253 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1501 microversion: 2.1 time: 0.408659 Jun 17 07:36:12.777882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 133/268] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:12 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1501 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:12.778118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-93fdb18a-eb14-4588-822f-42b58ed40390 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:12.778118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-93fdb18a-eb14-4588-822f-42b58ed40390 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:12.778118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93fdb18a-eb14-4588-822f-42b58ed40390 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:12.778118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93fdb18a-eb14-4588-822f-42b58ed40390 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:12.778803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93fdb18a-eb14-4588-822f-42b58ed40390 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:12.778803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93fdb18a-eb14-4588-822f-42b58ed40390 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:12.947650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-93fdb18a-eb14-4588-822f-42b58ed40390 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:12.963581 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-93fdb18a-eb14-4588-822f-42b58ed40390 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1516 microversion: 2.1 time: 0.201215 Jun 17 07:36:12.964865 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 136/269] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:12 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:16.143882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3facc1af-1c73-414a-a2ff-d056a5fa3584 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:36:16.150194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3facc1af-1c73-414a-a2ff-d056a5fa3584 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:16.163936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3facc1af-1c73-414a-a2ff-d056a5fa3584 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:16.164333 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3facc1af-1c73-414a-a2ff-d056a5fa3584 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:16.165503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3facc1af-1c73-414a-a2ff-d056a5fa3584 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:16.166103 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3facc1af-1c73-414a-a2ff-d056a5fa3584 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:16.197780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-3facc1af-1c73-414a-a2ff-d056a5fa3584 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lazy-loading 'flavor' on Instance uuid e5abf359-6883-489c-b6bc-d6456efc857d {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:36:16.538763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3facc1af-1c73-414a-a2ff-d056a5fa3584 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d/action" status: 200 len: 32 microversion: 2.1 time: 0.400913 Jun 17 07:36:16.541377 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 134/270] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:36:16 2022] POST /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:36:16.551331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1887b323-5b1d-4bd4-be0e-66fccfb28603 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:16.553977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1887b323-5b1d-4bd4-be0e-66fccfb28603 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:16.564775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1887b323-5b1d-4bd4-be0e-66fccfb28603 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:16.564775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1887b323-5b1d-4bd4-be0e-66fccfb28603 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:16.564775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1887b323-5b1d-4bd4-be0e-66fccfb28603 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:16.564775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1887b323-5b1d-4bd4-be0e-66fccfb28603 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:16.893207 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1887b323-5b1d-4bd4-be0e-66fccfb28603 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:16.901801 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1887b323-5b1d-4bd4-be0e-66fccfb28603 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.355920 Jun 17 07:36:16.912335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 137/271] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:16 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:17.920616 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-22037903-0b71-4e50-aa72-0f7edc7242ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:17.922020 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-22037903-0b71-4e50-aa72-0f7edc7242ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:17.931278 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-22037903-0b71-4e50-aa72-0f7edc7242ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:17.931806 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-22037903-0b71-4e50-aa72-0f7edc7242ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:17.932692 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-22037903-0b71-4e50-aa72-0f7edc7242ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:17.933213 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-22037903-0b71-4e50-aa72-0f7edc7242ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:18.172231 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-22037903-0b71-4e50-aa72-0f7edc7242ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:18.193678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-22037903-0b71-4e50-aa72-0f7edc7242ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.271567 Jun 17 07:36:18.195285 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 135/272] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:17 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:19.219355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7dbd5b32-8882-4524-8329-67fb82fd9407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:19.220998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7dbd5b32-8882-4524-8329-67fb82fd9407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:19.234035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7dbd5b32-8882-4524-8329-67fb82fd9407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:19.234791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7dbd5b32-8882-4524-8329-67fb82fd9407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:19.235821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7dbd5b32-8882-4524-8329-67fb82fd9407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:19.236984 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7dbd5b32-8882-4524-8329-67fb82fd9407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:19.394876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7dbd5b32-8882-4524-8329-67fb82fd9407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:19.408122 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7dbd5b32-8882-4524-8329-67fb82fd9407 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.197382 Jun 17 07:36:19.408722 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 138/273] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:19 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:20.426495 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2b0aaa53-cda5-48a8-83f3-bbb9ca1402d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:20.428180 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2b0aaa53-cda5-48a8-83f3-bbb9ca1402d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:20.441159 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2b0aaa53-cda5-48a8-83f3-bbb9ca1402d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:20.441987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2b0aaa53-cda5-48a8-83f3-bbb9ca1402d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:20.443055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2b0aaa53-cda5-48a8-83f3-bbb9ca1402d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:20.444815 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2b0aaa53-cda5-48a8-83f3-bbb9ca1402d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:21.236004 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2b0aaa53-cda5-48a8-83f3-bbb9ca1402d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:21.243898 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2b0aaa53-cda5-48a8-83f3-bbb9ca1402d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.822180 Jun 17 07:36:21.244492 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 136/274] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:20 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:22.262110 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-14ec12de-ffec-460f-b075-a7df2386cc56 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:22.263367 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-14ec12de-ffec-460f-b075-a7df2386cc56 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:22.272455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-14ec12de-ffec-460f-b075-a7df2386cc56 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:22.280716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-14ec12de-ffec-460f-b075-a7df2386cc56 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:22.283058 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-14ec12de-ffec-460f-b075-a7df2386cc56 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:22.283673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-14ec12de-ffec-460f-b075-a7df2386cc56 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:22.600899 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-14ec12de-ffec-460f-b075-a7df2386cc56 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:22.618316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-14ec12de-ffec-460f-b075-a7df2386cc56 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.360120 Jun 17 07:36:22.618923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 139/275] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:22 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:23.636184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5a972e72-69b7-4edc-b1d6-f7c9844b518c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:23.636885 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5a972e72-69b7-4edc-b1d6-f7c9844b518c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:23.643749 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a972e72-69b7-4edc-b1d6-f7c9844b518c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:23.644455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a972e72-69b7-4edc-b1d6-f7c9844b518c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:23.646230 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a972e72-69b7-4edc-b1d6-f7c9844b518c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:23.647026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a972e72-69b7-4edc-b1d6-f7c9844b518c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:23.993752 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5a972e72-69b7-4edc-b1d6-f7c9844b518c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:24.009363 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5a972e72-69b7-4edc-b1d6-f7c9844b518c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.377404 Jun 17 07:36:24.010746 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 137/276] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:23 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:25.027750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d6b52a83-a81d-48a7-905c-d4d995b009b3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:25.029030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d6b52a83-a81d-48a7-905c-d4d995b009b3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:25.046179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d6b52a83-a81d-48a7-905c-d4d995b009b3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:25.047324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d6b52a83-a81d-48a7-905c-d4d995b009b3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:25.048354 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d6b52a83-a81d-48a7-905c-d4d995b009b3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:25.048957 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d6b52a83-a81d-48a7-905c-d4d995b009b3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:25.087599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:25.428643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d6b52a83-a81d-48a7-905c-d4d995b009b3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:25.447351 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d6b52a83-a81d-48a7-905c-d4d995b009b3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.423459 Jun 17 07:36:25.451672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 140/277] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:25 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:25.939105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-83996bdd-62fd-406e-a71a-a4e3beceb8d5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'create', calling method: .version_select at 0x7fb069e54310>, body: {"keypair": {"name": "tempest-keypair-150197160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgfLr5JdxmM13Izmxi4TSo/brsP5nqFcUZPtxoFs5VEtep1lLKT9kiYiF2mF+ugNlJ+l65+ASh/OzLCHmOi5czShbRillohgZYQ+HmAxHRkPkY01+yyPMIiiaibUTYaDg=="}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:36:25.976079 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-83996bdd-62fd-406e-a71a-a4e3beceb8d5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Getting quotas for project ae461627578a489a9a6a9569cee15eb8. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:36:25.988288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-83996bdd-62fd-406e-a71a-a4e3beceb8d5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Getting quotas for user c9c07cf08d9c45479f9530efe9dcad2a and project ae461627578a489a9a6a9569cee15eb8. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:36:26.170525 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-83996bdd-62fd-406e-a71a-a4e3beceb8d5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.456759 Jun 17 07:36:26.170525 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 138/278] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:36:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:36:26.475974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9d2dd28d-3bd4-49c8-89c3-adbb8c6b5afd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:26.476802 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9d2dd28d-3bd4-49c8-89c3-adbb8c6b5afd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:26.503970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9d2dd28d-3bd4-49c8-89c3-adbb8c6b5afd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:26.504400 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9d2dd28d-3bd4-49c8-89c3-adbb8c6b5afd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:26.514058 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9d2dd28d-3bd4-49c8-89c3-adbb8c6b5afd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:26.514748 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9d2dd28d-3bd4-49c8-89c3-adbb8c6b5afd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:26.867709 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9d2dd28d-3bd4-49c8-89c3-adbb8c6b5afd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:26.877203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9d2dd28d-3bd4-49c8-89c3-adbb8c6b5afd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.407764 Jun 17 07:36:26.878483 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 141/279] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:26 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:27.858300 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5afacbce-54c0-4b09-a184-16ac7f193443 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Action: 'create', calling method: .version_select at 0x7fb069e5d4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1192281260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvrH2pJfVW7JBOQLvso/f3Zs1g7DeKZ+F08rBc4q9DkMlmBBl4G1V8ySjKfaXJ9ouHJ/a3trFyEl5Y0lrojI4XB71mMRQxV0pCKV7UWyyQSktQ8XMa4l5evNxkPNupCmg=="}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:36:27.874164 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-5afacbce-54c0-4b09-a184-16ac7f193443 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Getting quotas for project 8705999014cf43e1b1ccd5186b67b4bd. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:36:27.878010 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-5afacbce-54c0-4b09-a184-16ac7f193443 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Getting quotas for user 781e29f49f27417a96cfc4ba00af95dd and project 8705999014cf43e1b1ccd5186b67b4bd. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:36:27.896321 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c5887f0d-f09c-44d1-87e6-e7e2d9961d17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:27.901800 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c5887f0d-f09c-44d1-87e6-e7e2d9961d17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:27.903265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c5887f0d-f09c-44d1-87e6-e7e2d9961d17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:27.903710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c5887f0d-f09c-44d1-87e6-e7e2d9961d17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:27.904472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c5887f0d-f09c-44d1-87e6-e7e2d9961d17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:27.904909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c5887f0d-f09c-44d1-87e6-e7e2d9961d17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:28.013838 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5afacbce-54c0-4b09-a184-16ac7f193443 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.262748 Jun 17 07:36:28.015711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 139/280] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:36:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:36:28.128275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c5887f0d-f09c-44d1-87e6-e7e2d9961d17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:28.136342 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c5887f0d-f09c-44d1-87e6-e7e2d9961d17 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.244195 Jun 17 07:36:28.154295 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 142/281] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:27 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:29.106734 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1137753507", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d39f224e-8e41-41d1-b926-98d1d555c539"}], "security_groups": [{"name": "tempest-securitygroup--1600932726"}], "key_name": "tempest-keypair-150197160", "user_data": "}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:36:29.159671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e4ecf2f2-2608-472b-8517-5c15a02ef469 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:29.160282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e4ecf2f2-2608-472b-8517-5c15a02ef469 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:29.171279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e4ecf2f2-2608-472b-8517-5c15a02ef469 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:29.171841 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e4ecf2f2-2608-472b-8517-5c15a02ef469 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:29.172758 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e4ecf2f2-2608-472b-8517-5c15a02ef469 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:29.173300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e4ecf2f2-2608-472b-8517-5c15a02ef469 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:29.229601 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] validate_networks() for [('d39f224e-8e41-41d1-b926-98d1d555c539', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:36:29.346668 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e4ecf2f2-2608-472b-8517-5c15a02ef469 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:29.355214 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e4ecf2f2-2608-472b-8517-5c15a02ef469 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.205469 Jun 17 07:36:29.358938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 143/282] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:29 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:29.681512 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:36:29.682359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:36:29.682971 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:36:29.684055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:36:29.685651 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:36:29.696663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:29.697120 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:29.698022 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:29.698461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:29.716344 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Getting quotas for project ae461627578a489a9a6a9569cee15eb8. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:36:29.720405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Getting quotas for user c9c07cf08d9c45479f9530efe9dcad2a and project ae461627578a489a9a6a9569cee15eb8. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:36:29.732481 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:36:29.734779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:36:29.866591 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-de11cc72-c948-4e18-9c5f-279c21b96a0c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.765851 Jun 17 07:36:29.867239 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 140/283] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:36:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:36:29.877629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4f56e63b-849e-477e-8888-4d62d1d1bbbc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:29.878768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4f56e63b-849e-477e-8888-4d62d1d1bbbc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:29.968067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4f56e63b-849e-477e-8888-4d62d1d1bbbc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:29.978991 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4f56e63b-849e-477e-8888-4d62d1d1bbbc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1237 microversion: 2.1 time: 0.102992 Jun 17 07:36:29.978991 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 144/284] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:29 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:30.372841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-decf7d24-4b88-4c1b-a54c-497ed9df8a2a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:30.373456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-decf7d24-4b88-4c1b-a54c-497ed9df8a2a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:30.381730 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-decf7d24-4b88-4c1b-a54c-497ed9df8a2a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:30.382544 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-decf7d24-4b88-4c1b-a54c-497ed9df8a2a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:30.383524 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-decf7d24-4b88-4c1b-a54c-497ed9df8a2a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:30.384166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-decf7d24-4b88-4c1b-a54c-497ed9df8a2a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:30.541761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-decf7d24-4b88-4c1b-a54c-497ed9df8a2a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:30.549841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-decf7d24-4b88-4c1b-a54c-497ed9df8a2a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.181627 Jun 17 07:36:30.550421 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 141/285] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:30 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:31.001791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a96ad246-da63-4159-b034-f948ff04215c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:31.005659 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a96ad246-da63-4159-b034-f948ff04215c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:31.073915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a96ad246-da63-4159-b034-f948ff04215c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:31.080630 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a96ad246-da63-4159-b034-f948ff04215c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1237 microversion: 2.1 time: 0.082565 Jun 17 07:36:31.081220 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 145/286] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:30 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:31.567148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c2699ead-e804-4889-916d-2db7e1a56f50 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:31.567793 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c2699ead-e804-4889-916d-2db7e1a56f50 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:31.580858 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2699ead-e804-4889-916d-2db7e1a56f50 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:31.581353 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2699ead-e804-4889-916d-2db7e1a56f50 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:31.586392 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2699ead-e804-4889-916d-2db7e1a56f50 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:31.586920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2699ead-e804-4889-916d-2db7e1a56f50 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:31.925729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c2699ead-e804-4889-916d-2db7e1a56f50 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:31.936886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c2699ead-e804-4889-916d-2db7e1a56f50 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.373584 Jun 17 07:36:31.947453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 142/287] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:31 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:32.105801 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3b9eb6f4-b5a0-4df5-af17-dad8442ab650 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:32.105801 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3b9eb6f4-b5a0-4df5-af17-dad8442ab650 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:32.108833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9eb6f4-b5a0-4df5-af17-dad8442ab650 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:32.109284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9eb6f4-b5a0-4df5-af17-dad8442ab650 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:32.110255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9eb6f4-b5a0-4df5-af17-dad8442ab650 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:32.110847 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9eb6f4-b5a0-4df5-af17-dad8442ab650 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:32.195083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3b9eb6f4-b5a0-4df5-af17-dad8442ab650 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:32.202434 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3b9eb6f4-b5a0-4df5-af17-dad8442ab650 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1233 microversion: 2.1 time: 0.107436 Jun 17 07:36:32.203324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 146/288] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:32 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1233 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:32.973642 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-755835cd-ebc2-47da-9e94-fe7c72113a1a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:32.980544 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-755835cd-ebc2-47da-9e94-fe7c72113a1a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:33.004044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=5 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:33.007729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-755835cd-ebc2-47da-9e94-fe7c72113a1a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:33.008334 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-755835cd-ebc2-47da-9e94-fe7c72113a1a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:33.012896 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-755835cd-ebc2-47da-9e94-fe7c72113a1a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:33.013387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-755835cd-ebc2-47da-9e94-fe7c72113a1a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:33.220427 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cfa90cb7-19a1-4485-854f-bfa5f68a39f1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:33.223167 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-755835cd-ebc2-47da-9e94-fe7c72113a1a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:33.224984 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cfa90cb7-19a1-4485-854f-bfa5f68a39f1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:33.243080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cfa90cb7-19a1-4485-854f-bfa5f68a39f1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:33.243533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cfa90cb7-19a1-4485-854f-bfa5f68a39f1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:33.249435 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cfa90cb7-19a1-4485-854f-bfa5f68a39f1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:33.249971 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cfa90cb7-19a1-4485-854f-bfa5f68a39f1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:33.252120 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-755835cd-ebc2-47da-9e94-fe7c72113a1a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.288334 Jun 17 07:36:33.287467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 143/289] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:32 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:33.435694 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cfa90cb7-19a1-4485-854f-bfa5f68a39f1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:33.446404 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cfa90cb7-19a1-4485-854f-bfa5f68a39f1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1297 microversion: 2.1 time: 0.230096 Jun 17 07:36:33.447003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 147/290] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:33 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1297 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:34.271689 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-906a9c7a-0c9e-4f0c-a6f8-2627e0c63849 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:34.272650 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-906a9c7a-0c9e-4f0c-a6f8-2627e0c63849 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:34.279730 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-906a9c7a-0c9e-4f0c-a6f8-2627e0c63849 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:34.280472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-906a9c7a-0c9e-4f0c-a6f8-2627e0c63849 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:34.281298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-906a9c7a-0c9e-4f0c-a6f8-2627e0c63849 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:34.281980 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-906a9c7a-0c9e-4f0c-a6f8-2627e0c63849 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:34.465137 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0bde1089-c2e0-441d-90e3-83aa5930b6ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:34.466404 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0bde1089-c2e0-441d-90e3-83aa5930b6ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:34.468326 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=48 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:34.473193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0bde1089-c2e0-441d-90e3-83aa5930b6ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:34.473831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0bde1089-c2e0-441d-90e3-83aa5930b6ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:34.475416 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0bde1089-c2e0-441d-90e3-83aa5930b6ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:34.475851 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0bde1089-c2e0-441d-90e3-83aa5930b6ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:34.508467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-906a9c7a-0c9e-4f0c-a6f8-2627e0c63849 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:34.525310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-906a9c7a-0c9e-4f0c-a6f8-2627e0c63849 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.258712 Jun 17 07:36:34.531887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 144/291] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:34 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:34.647696 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0bde1089-c2e0-441d-90e3-83aa5930b6ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:34.665542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0bde1089-c2e0-441d-90e3-83aa5930b6ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.203077 Jun 17 07:36:34.665976 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 148/292] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:34 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:35.549213 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6d5a7328-2b0d-4d20-940e-4cfc7d31dc1e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:35.550615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6d5a7328-2b0d-4d20-940e-4cfc7d31dc1e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:35.560637 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d5a7328-2b0d-4d20-940e-4cfc7d31dc1e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:35.561413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d5a7328-2b0d-4d20-940e-4cfc7d31dc1e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:35.562371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d5a7328-2b0d-4d20-940e-4cfc7d31dc1e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:35.563110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d5a7328-2b0d-4d20-940e-4cfc7d31dc1e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:35.573633 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:35.689216 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7a3edfb2-7705-4c6f-ad25-3b369a4a799e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:35.689863 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7a3edfb2-7705-4c6f-ad25-3b369a4a799e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:35.697183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7a3edfb2-7705-4c6f-ad25-3b369a4a799e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:35.697966 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7a3edfb2-7705-4c6f-ad25-3b369a4a799e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:35.699021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7a3edfb2-7705-4c6f-ad25-3b369a4a799e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:35.699455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7a3edfb2-7705-4c6f-ad25-3b369a4a799e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:35.787434 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6d5a7328-2b0d-4d20-940e-4cfc7d31dc1e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:35.798405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6d5a7328-2b0d-4d20-940e-4cfc7d31dc1e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.252960 Jun 17 07:36:35.800274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 145/293] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:35 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:35.859916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7a3edfb2-7705-4c6f-ad25-3b369a4a799e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:35.868672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7a3edfb2-7705-4c6f-ad25-3b369a4a799e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.190973 Jun 17 07:36:35.869250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 149/294] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:35 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:35.972447 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-225949cc-317b-4052-937a-db5e86ce0f16 req-aa2ed5d0-bb48-49b8-b539-e52ea015e2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8444090b-ae6f-4602-a407-fbc601de5625", "tag": "19c183bd-b52f-4034-8235-199f76f21ce8"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:36:35.980882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-225949cc-317b-4052-937a-db5e86ce0f16 req-aa2ed5d0-bb48-49b8-b539-e52ea015e2d4 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:35.981388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-225949cc-317b-4052-937a-db5e86ce0f16 req-aa2ed5d0-bb48-49b8-b539-e52ea015e2d4 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:35.993343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-225949cc-317b-4052-937a-db5e86ce0f16 req-aa2ed5d0-bb48-49b8-b539-e52ea015e2d4 service nova] Creating event network-changed:19c183bd-b52f-4034-8235-199f76f21ce8 for instance 8444090b-ae6f-4602-a407-fbc601de5625 on hv-cinder-79733 Jun 17 07:36:35.998598 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-225949cc-317b-4052-937a-db5e86ce0f16 req-aa2ed5d0-bb48-49b8-b539-e52ea015e2d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029832 Jun 17 07:36:35.999848 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 146/295] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:36:36.816134 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-696b972a-9c9f-401d-90e8-5ced1fd632a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:36.816752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-696b972a-9c9f-401d-90e8-5ced1fd632a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:36.823194 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-696b972a-9c9f-401d-90e8-5ced1fd632a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:36.823643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-696b972a-9c9f-401d-90e8-5ced1fd632a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:36.824401 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-696b972a-9c9f-401d-90e8-5ced1fd632a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:36.824835 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-696b972a-9c9f-401d-90e8-5ced1fd632a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:36.887967 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-97125f1f-c789-482a-b3d2-50b8d973c03a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:36.888931 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-97125f1f-c789-482a-b3d2-50b8d973c03a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:36.897350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-97125f1f-c789-482a-b3d2-50b8d973c03a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:36.897802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-97125f1f-c789-482a-b3d2-50b8d973c03a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:36.898577 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-97125f1f-c789-482a-b3d2-50b8d973c03a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:36.899015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-97125f1f-c789-482a-b3d2-50b8d973c03a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:36.994299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-696b972a-9c9f-401d-90e8-5ced1fd632a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:37.002084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-696b972a-9c9f-401d-90e8-5ced1fd632a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.189896 Jun 17 07:36:37.002700 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 150/296] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:36 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:37.057868 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-97125f1f-c789-482a-b3d2-50b8d973c03a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:37.065297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-97125f1f-c789-482a-b3d2-50b8d973c03a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.182553 Jun 17 07:36:37.065882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 147/297] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:36 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:38.019735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0d88cc70-c550-445d-a67a-9382a2ce951b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:38.020834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0d88cc70-c550-445d-a67a-9382a2ce951b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:38.028947 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d88cc70-c550-445d-a67a-9382a2ce951b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:38.036978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d88cc70-c550-445d-a67a-9382a2ce951b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:38.036978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d88cc70-c550-445d-a67a-9382a2ce951b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:38.036978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d88cc70-c550-445d-a67a-9382a2ce951b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:38.089634 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f1c0d55f-16f9-4c09-83ea-567346aa94db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:38.090318 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f1c0d55f-16f9-4c09-83ea-567346aa94db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:38.097583 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1c0d55f-16f9-4c09-83ea-567346aa94db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:38.097583 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1c0d55f-16f9-4c09-83ea-567346aa94db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:38.098260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1c0d55f-16f9-4c09-83ea-567346aa94db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:38.099260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1c0d55f-16f9-4c09-83ea-567346aa94db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:38.187989 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0d88cc70-c550-445d-a67a-9382a2ce951b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:38.198325 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0d88cc70-c550-445d-a67a-9382a2ce951b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.182468 Jun 17 07:36:38.198920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 151/298] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:38 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:38.262936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f1c0d55f-16f9-4c09-83ea-567346aa94db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:38.272135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f1c0d55f-16f9-4c09-83ea-567346aa94db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.186342 Jun 17 07:36:38.272864 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 148/299] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:38 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:39.216064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e382abea-324a-4626-9e4c-7ef52fef2fae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:39.216748 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e382abea-324a-4626-9e4c-7ef52fef2fae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:39.222890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e382abea-324a-4626-9e4c-7ef52fef2fae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:39.230328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e382abea-324a-4626-9e4c-7ef52fef2fae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:39.230328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e382abea-324a-4626-9e4c-7ef52fef2fae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:39.230328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e382abea-324a-4626-9e4c-7ef52fef2fae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:39.291681 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f1361a0c-8e7d-461a-b4d0-946dc62984ae tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:39.292349 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f1361a0c-8e7d-461a-b4d0-946dc62984ae tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:39.304387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1361a0c-8e7d-461a-b4d0-946dc62984ae tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:39.306961 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1361a0c-8e7d-461a-b4d0-946dc62984ae tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:39.311782 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1361a0c-8e7d-461a-b4d0-946dc62984ae tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:39.312227 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1361a0c-8e7d-461a-b4d0-946dc62984ae tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:39.393154 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e382abea-324a-4626-9e4c-7ef52fef2fae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:39.403340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e382abea-324a-4626-9e4c-7ef52fef2fae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.191187 Jun 17 07:36:39.403920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 152/300] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:39 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:39.454011 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f1361a0c-8e7d-461a-b4d0-946dc62984ae tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:39.462404 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f1361a0c-8e7d-461a-b4d0-946dc62984ae tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.176061 Jun 17 07:36:39.462974 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 149/301] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:39 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:40.422914 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-526a3f6f-497f-4faa-9d4e-0a7b8f214841 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:40.423645 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-526a3f6f-497f-4faa-9d4e-0a7b8f214841 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:40.431542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-526a3f6f-497f-4faa-9d4e-0a7b8f214841 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:40.431990 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-526a3f6f-497f-4faa-9d4e-0a7b8f214841 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:40.432801 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-526a3f6f-497f-4faa-9d4e-0a7b8f214841 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:40.433366 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-526a3f6f-497f-4faa-9d4e-0a7b8f214841 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:40.480490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b06072cd-c0f1-4250-9f14-7e6845f7939a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:40.481255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b06072cd-c0f1-4250-9f14-7e6845f7939a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:40.485060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:40.485894 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=14 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:40.491729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b06072cd-c0f1-4250-9f14-7e6845f7939a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:40.496414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b06072cd-c0f1-4250-9f14-7e6845f7939a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:40.496414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b06072cd-c0f1-4250-9f14-7e6845f7939a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:40.496414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b06072cd-c0f1-4250-9f14-7e6845f7939a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:40.639437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b06072cd-c0f1-4250-9f14-7e6845f7939a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:40.650277 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b06072cd-c0f1-4250-9f14-7e6845f7939a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.172409 Jun 17 07:36:40.651783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 150/302] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:40 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:40.674014 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-526a3f6f-497f-4faa-9d4e-0a7b8f214841 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:40.683416 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-526a3f6f-497f-4faa-9d4e-0a7b8f214841 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.267081 Jun 17 07:36:40.688755 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 153/303] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:40 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:41.670576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-64e3c40d-43c7-4587-879d-591d514fa7e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:41.671130 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-64e3c40d-43c7-4587-879d-591d514fa7e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:41.677997 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-64e3c40d-43c7-4587-879d-591d514fa7e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:41.678671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-64e3c40d-43c7-4587-879d-591d514fa7e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:41.679597 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-64e3c40d-43c7-4587-879d-591d514fa7e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:41.680040 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-64e3c40d-43c7-4587-879d-591d514fa7e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:41.702121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-81c3e2cc-6532-4b87-a6dd-81dd4eb9a508 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:41.702740 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-81c3e2cc-6532-4b87-a6dd-81dd4eb9a508 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:41.704572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=4 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:41.714641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81c3e2cc-6532-4b87-a6dd-81dd4eb9a508 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:41.715102 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81c3e2cc-6532-4b87-a6dd-81dd4eb9a508 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:41.715905 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81c3e2cc-6532-4b87-a6dd-81dd4eb9a508 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:41.716362 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81c3e2cc-6532-4b87-a6dd-81dd4eb9a508 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:41.826679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-64e3c40d-43c7-4587-879d-591d514fa7e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:41.836135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-64e3c40d-43c7-4587-879d-591d514fa7e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.171488 Jun 17 07:36:41.836854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 151/304] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:41 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:41.866679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-81c3e2cc-6532-4b87-a6dd-81dd4eb9a508 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:41.874469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-81c3e2cc-6532-4b87-a6dd-81dd4eb9a508 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.176316 Jun 17 07:36:41.875034 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 154/305] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:41 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:42.853364 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3130634a-46d6-45fa-9189-2b81e82eca55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:42.855823 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3130634a-46d6-45fa-9189-2b81e82eca55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:42.860848 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3130634a-46d6-45fa-9189-2b81e82eca55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:42.861540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3130634a-46d6-45fa-9189-2b81e82eca55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:42.862302 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3130634a-46d6-45fa-9189-2b81e82eca55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:42.862733 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3130634a-46d6-45fa-9189-2b81e82eca55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:42.892226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5b1cda49-4bd1-47fd-bd49-dcd1caad8995 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:42.892859 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5b1cda49-4bd1-47fd-bd49-dcd1caad8995 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:42.899826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5b1cda49-4bd1-47fd-bd49-dcd1caad8995 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:42.900267 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5b1cda49-4bd1-47fd-bd49-dcd1caad8995 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:42.901028 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5b1cda49-4bd1-47fd-bd49-dcd1caad8995 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:42.901491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5b1cda49-4bd1-47fd-bd49-dcd1caad8995 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:43.028271 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3130634a-46d6-45fa-9189-2b81e82eca55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:43.034969 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3130634a-46d6-45fa-9189-2b81e82eca55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.186121 Jun 17 07:36:43.035820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 152/306] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:42 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:43.060346 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5b1cda49-4bd1-47fd-bd49-dcd1caad8995 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:43.067907 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5b1cda49-4bd1-47fd-bd49-dcd1caad8995 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.179683 Jun 17 07:36:43.068687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 155/307] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:42 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:44.053794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bd6cccc1-c1bf-4a63-afa4-3e0c72a9e54f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:44.055046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bd6cccc1-c1bf-4a63-afa4-3e0c72a9e54f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:44.062080 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bd6cccc1-c1bf-4a63-afa4-3e0c72a9e54f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:44.062636 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bd6cccc1-c1bf-4a63-afa4-3e0c72a9e54f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:44.063547 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bd6cccc1-c1bf-4a63-afa4-3e0c72a9e54f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:44.064350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bd6cccc1-c1bf-4a63-afa4-3e0c72a9e54f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:44.085440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9abbfd3a-2c81-4e94-af22-dbd745c417fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:44.086181 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9abbfd3a-2c81-4e94-af22-dbd745c417fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:44.093340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9abbfd3a-2c81-4e94-af22-dbd745c417fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:44.093857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9abbfd3a-2c81-4e94-af22-dbd745c417fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:44.094661 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9abbfd3a-2c81-4e94-af22-dbd745c417fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:44.095300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9abbfd3a-2c81-4e94-af22-dbd745c417fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:44.204166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-bd6cccc1-c1bf-4a63-afa4-3e0c72a9e54f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:44.212607 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bd6cccc1-c1bf-4a63-afa4-3e0c72a9e54f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.163252 Jun 17 07:36:44.213183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 153/308] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:44 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:44.243563 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9abbfd3a-2c81-4e94-af22-dbd745c417fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:44.254404 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9abbfd3a-2c81-4e94-af22-dbd745c417fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.174240 Jun 17 07:36:44.254989 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 156/309] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:44 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:45.230108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a399fd68-d6a0-454b-9f91-a5ea33ca7f1f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:45.231551 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a399fd68-d6a0-454b-9f91-a5ea33ca7f1f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:45.237979 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a399fd68-d6a0-454b-9f91-a5ea33ca7f1f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:45.238424 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a399fd68-d6a0-454b-9f91-a5ea33ca7f1f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:45.239177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a399fd68-d6a0-454b-9f91-a5ea33ca7f1f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:45.239611 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a399fd68-d6a0-454b-9f91-a5ea33ca7f1f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:45.276009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-53b97cc8-6afc-40a7-9a25-aafbbc16ab9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:45.276652 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-53b97cc8-6afc-40a7-9a25-aafbbc16ab9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:45.283044 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53b97cc8-6afc-40a7-9a25-aafbbc16ab9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:45.283586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53b97cc8-6afc-40a7-9a25-aafbbc16ab9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:45.284410 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53b97cc8-6afc-40a7-9a25-aafbbc16ab9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:45.284848 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53b97cc8-6afc-40a7-9a25-aafbbc16ab9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:45.376978 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a399fd68-d6a0-454b-9f91-a5ea33ca7f1f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:45.387417 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a399fd68-d6a0-454b-9f91-a5ea33ca7f1f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.160983 Jun 17 07:36:45.388281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 154/310] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:45 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:45.432672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-53b97cc8-6afc-40a7-9a25-aafbbc16ab9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:45.440125 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-53b97cc8-6afc-40a7-9a25-aafbbc16ab9e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.168236 Jun 17 07:36:45.440694 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 157/311] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:45 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:46.405401 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3b8cf633-87f8-46ce-84de-a1cfad600a56 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:46.405888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3b8cf633-87f8-46ce-84de-a1cfad600a56 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:46.412406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3b8cf633-87f8-46ce-84de-a1cfad600a56 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:46.412847 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3b8cf633-87f8-46ce-84de-a1cfad600a56 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:46.413626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3b8cf633-87f8-46ce-84de-a1cfad600a56 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:46.414054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3b8cf633-87f8-46ce-84de-a1cfad600a56 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:46.457930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0e2f0301-88cc-4b7a-94b8-4f1515d4fdfb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:46.458595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0e2f0301-88cc-4b7a-94b8-4f1515d4fdfb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:46.464607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e2f0301-88cc-4b7a-94b8-4f1515d4fdfb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:46.465050 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e2f0301-88cc-4b7a-94b8-4f1515d4fdfb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:46.467372 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e2f0301-88cc-4b7a-94b8-4f1515d4fdfb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:46.467549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e2f0301-88cc-4b7a-94b8-4f1515d4fdfb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:46.549504 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3b8cf633-87f8-46ce-84de-a1cfad600a56 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:46.558411 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3b8cf633-87f8-46ce-84de-a1cfad600a56 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.156854 Jun 17 07:36:46.559020 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 155/312] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:46 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:46.601910 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0e2f0301-88cc-4b7a-94b8-4f1515d4fdfb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:46.609798 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0e2f0301-88cc-4b7a-94b8-4f1515d4fdfb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.155747 Jun 17 07:36:46.610364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 158/313] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:46 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:47.575668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-10efdaae-e747-4c36-8cc6-69a58330d2b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:47.576252 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-10efdaae-e747-4c36-8cc6-69a58330d2b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:47.582701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10efdaae-e747-4c36-8cc6-69a58330d2b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:47.583139 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10efdaae-e747-4c36-8cc6-69a58330d2b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:47.583893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10efdaae-e747-4c36-8cc6-69a58330d2b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:47.584322 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10efdaae-e747-4c36-8cc6-69a58330d2b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:47.627531 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-da94a316-6138-449c-bcf6-b7278abcd4d5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:47.628139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-da94a316-6138-449c-bcf6-b7278abcd4d5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:47.634130 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da94a316-6138-449c-bcf6-b7278abcd4d5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:47.634569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da94a316-6138-449c-bcf6-b7278abcd4d5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:47.635322 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da94a316-6138-449c-bcf6-b7278abcd4d5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:47.635749 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-da94a316-6138-449c-bcf6-b7278abcd4d5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:47.639779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:47.728121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-10efdaae-e747-4c36-8cc6-69a58330d2b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:47.736297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-10efdaae-e747-4c36-8cc6-69a58330d2b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.164304 Jun 17 07:36:47.746261 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 156/314] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:47 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:47.775031 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-da94a316-6138-449c-bcf6-b7278abcd4d5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:47.782480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-da94a316-6138-449c-bcf6-b7278abcd4d5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.158864 Jun 17 07:36:47.783029 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 159/315] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:47 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:48.753276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b977b131-2e8d-49c7-a72c-f10438a5f8af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:48.753926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b977b131-2e8d-49c7-a72c-f10438a5f8af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:48.761239 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b977b131-2e8d-49c7-a72c-f10438a5f8af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:48.761716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b977b131-2e8d-49c7-a72c-f10438a5f8af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:48.762483 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b977b131-2e8d-49c7-a72c-f10438a5f8af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:48.762917 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b977b131-2e8d-49c7-a72c-f10438a5f8af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:48.800243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ad9d51ce-afdc-4307-bf93-587451c946da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:48.801740 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ad9d51ce-afdc-4307-bf93-587451c946da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:48.809223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ad9d51ce-afdc-4307-bf93-587451c946da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:48.809979 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ad9d51ce-afdc-4307-bf93-587451c946da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:48.810974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ad9d51ce-afdc-4307-bf93-587451c946da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:48.811738 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ad9d51ce-afdc-4307-bf93-587451c946da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:48.915194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b977b131-2e8d-49c7-a72c-f10438a5f8af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:48.922973 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b977b131-2e8d-49c7-a72c-f10438a5f8af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.173344 Jun 17 07:36:48.923673 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 157/316] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:48 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:48.950791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ad9d51ce-afdc-4307-bf93-587451c946da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:48.958730 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ad9d51ce-afdc-4307-bf93-587451c946da tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.162639 Jun 17 07:36:48.959372 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 160/317] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:48 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:49.939940 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-eb99dd34-b6b3-4859-9f43-a0ebf0b4baf1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:49.940546 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-eb99dd34-b6b3-4859-9f43-a0ebf0b4baf1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:49.947759 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eb99dd34-b6b3-4859-9f43-a0ebf0b4baf1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:49.948204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eb99dd34-b6b3-4859-9f43-a0ebf0b4baf1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:49.948959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eb99dd34-b6b3-4859-9f43-a0ebf0b4baf1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:49.949428 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eb99dd34-b6b3-4859-9f43-a0ebf0b4baf1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:49.976388 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8236e239-8fea-4253-b5d8-9a2e11c2fec0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:49.977672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8236e239-8fea-4253-b5d8-9a2e11c2fec0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:49.983608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8236e239-8fea-4253-b5d8-9a2e11c2fec0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:49.984051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8236e239-8fea-4253-b5d8-9a2e11c2fec0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:49.984971 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8236e239-8fea-4253-b5d8-9a2e11c2fec0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:49.985533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8236e239-8fea-4253-b5d8-9a2e11c2fec0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:50.095158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-eb99dd34-b6b3-4859-9f43-a0ebf0b4baf1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:50.113451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-eb99dd34-b6b3-4859-9f43-a0ebf0b4baf1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.177126 Jun 17 07:36:50.114507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 158/318] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:49 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:50.145634 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8236e239-8fea-4253-b5d8-9a2e11c2fec0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:50.152439 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8236e239-8fea-4253-b5d8-9a2e11c2fec0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.180149 Jun 17 07:36:50.153454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 161/319] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:49 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:51.131672 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fb2665c7-279c-418a-8209-1d9317123451 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:51.132248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fb2665c7-279c-418a-8209-1d9317123451 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:51.138705 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fb2665c7-279c-418a-8209-1d9317123451 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:51.139152 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fb2665c7-279c-418a-8209-1d9317123451 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:51.139902 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fb2665c7-279c-418a-8209-1d9317123451 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:51.140333 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fb2665c7-279c-418a-8209-1d9317123451 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:51.170485 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7d344e95-d916-4ab1-8b21-3b72d956f0fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:51.171087 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7d344e95-d916-4ab1-8b21-3b72d956f0fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:51.177705 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7d344e95-d916-4ab1-8b21-3b72d956f0fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:51.178809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7d344e95-d916-4ab1-8b21-3b72d956f0fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:51.179525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7d344e95-d916-4ab1-8b21-3b72d956f0fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:51.179965 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7d344e95-d916-4ab1-8b21-3b72d956f0fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:51.279618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fb2665c7-279c-418a-8209-1d9317123451 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:51.287732 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fb2665c7-279c-418a-8209-1d9317123451 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.160848 Jun 17 07:36:51.289044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 159/320] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:51 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:51.319970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7d344e95-d916-4ab1-8b21-3b72d956f0fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:51.327878 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7d344e95-d916-4ab1-8b21-3b72d956f0fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.161292 Jun 17 07:36:51.328433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 162/321] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:51 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:52.304963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fb548e96-7736-4e83-a512-205b7bb1d992 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:52.305602 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fb548e96-7736-4e83-a512-205b7bb1d992 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:52.312216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fb548e96-7736-4e83-a512-205b7bb1d992 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:52.312658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fb548e96-7736-4e83-a512-205b7bb1d992 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:52.313448 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fb548e96-7736-4e83-a512-205b7bb1d992 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:52.313882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fb548e96-7736-4e83-a512-205b7bb1d992 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:52.345083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5491a2bc-aa75-4a36-863b-011633acd07c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:52.346136 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5491a2bc-aa75-4a36-863b-011633acd07c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:52.352004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5491a2bc-aa75-4a36-863b-011633acd07c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:52.352447 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5491a2bc-aa75-4a36-863b-011633acd07c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:52.353213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5491a2bc-aa75-4a36-863b-011633acd07c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:52.353678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5491a2bc-aa75-4a36-863b-011633acd07c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:52.464602 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fb548e96-7736-4e83-a512-205b7bb1d992 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:52.473945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fb548e96-7736-4e83-a512-205b7bb1d992 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.173293 Jun 17 07:36:52.474622 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 160/322] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:52 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:52.501433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5491a2bc-aa75-4a36-863b-011633acd07c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:52.510691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5491a2bc-aa75-4a36-863b-011633acd07c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.169387 Jun 17 07:36:52.511287 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 163/323] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:52 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:53.490385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d66aa63b-b319-4e27-a61a-d371110c7647 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:53.491111 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d66aa63b-b319-4e27-a61a-d371110c7647 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:53.498002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d66aa63b-b319-4e27-a61a-d371110c7647 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:53.498455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d66aa63b-b319-4e27-a61a-d371110c7647 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:53.499269 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d66aa63b-b319-4e27-a61a-d371110c7647 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:53.499721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d66aa63b-b319-4e27-a61a-d371110c7647 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:53.528581 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-35481575-6a5b-424f-8724-d39f1575bef7 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:53.529220 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-35481575-6a5b-424f-8724-d39f1575bef7 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:53.535184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-35481575-6a5b-424f-8724-d39f1575bef7 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:53.535628 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-35481575-6a5b-424f-8724-d39f1575bef7 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:53.536382 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-35481575-6a5b-424f-8724-d39f1575bef7 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:53.536840 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-35481575-6a5b-424f-8724-d39f1575bef7 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:53.642437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d66aa63b-b319-4e27-a61a-d371110c7647 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:53.651315 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d66aa63b-b319-4e27-a61a-d371110c7647 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.164673 Jun 17 07:36:53.652025 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 161/324] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:53 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:53.676044 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-35481575-6a5b-424f-8724-d39f1575bef7 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:53.689535 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-35481575-6a5b-424f-8724-d39f1575bef7 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.161158 Jun 17 07:36:53.689535 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 164/325] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:53 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:54.669189 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2e5d356a-a39d-4cfc-a725-1344cbdab973 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:54.669957 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2e5d356a-a39d-4cfc-a725-1344cbdab973 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:54.676512 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e5d356a-a39d-4cfc-a725-1344cbdab973 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:54.676964 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e5d356a-a39d-4cfc-a725-1344cbdab973 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:54.678062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e5d356a-a39d-4cfc-a725-1344cbdab973 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:54.678502 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e5d356a-a39d-4cfc-a725-1344cbdab973 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:54.694133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:36:54.703939 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-39b041a5-48ac-463f-b2c7-58bf8d93ae90 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:54.704592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-39b041a5-48ac-463f-b2c7-58bf8d93ae90 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:54.711310 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-39b041a5-48ac-463f-b2c7-58bf8d93ae90 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:54.711747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-39b041a5-48ac-463f-b2c7-58bf8d93ae90 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:54.712544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-39b041a5-48ac-463f-b2c7-58bf8d93ae90 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:54.712982 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-39b041a5-48ac-463f-b2c7-58bf8d93ae90 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:54.816215 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2e5d356a-a39d-4cfc-a725-1344cbdab973 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:54.824946 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2e5d356a-a39d-4cfc-a725-1344cbdab973 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.159495 Jun 17 07:36:54.825620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 162/326] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:54 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:54.854304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-39b041a5-48ac-463f-b2c7-58bf8d93ae90 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:54.861650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-39b041a5-48ac-463f-b2c7-58bf8d93ae90 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.161437 Jun 17 07:36:54.862323 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 165/327] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:54 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:55.843285 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-50d2cc3c-f93c-4eab-bb53-54da4a2aa1ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:55.843893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-50d2cc3c-f93c-4eab-bb53-54da4a2aa1ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:55.852061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-50d2cc3c-f93c-4eab-bb53-54da4a2aa1ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:55.852677 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-50d2cc3c-f93c-4eab-bb53-54da4a2aa1ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:55.853712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-50d2cc3c-f93c-4eab-bb53-54da4a2aa1ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:55.854243 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-50d2cc3c-f93c-4eab-bb53-54da4a2aa1ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:55.878804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d7bf0f4f-4bc8-4545-8c67-c27251a887c8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:55.879404 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d7bf0f4f-4bc8-4545-8c67-c27251a887c8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:55.886809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d7bf0f4f-4bc8-4545-8c67-c27251a887c8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:55.887244 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d7bf0f4f-4bc8-4545-8c67-c27251a887c8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:55.888158 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d7bf0f4f-4bc8-4545-8c67-c27251a887c8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:55.888770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d7bf0f4f-4bc8-4545-8c67-c27251a887c8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:56.038397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-50d2cc3c-f93c-4eab-bb53-54da4a2aa1ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:56.048345 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-50d2cc3c-f93c-4eab-bb53-54da4a2aa1ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.208238 Jun 17 07:36:56.053759 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 163/328] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:55 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:56.098753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d7bf0f4f-4bc8-4545-8c67-c27251a887c8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:56.107009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d7bf0f4f-4bc8-4545-8c67-c27251a887c8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.231986 Jun 17 07:36:56.107690 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 166/329] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:55 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:57.065566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-36793527-a42f-4e6a-adde-3d2aef2ce60e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:57.066280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-36793527-a42f-4e6a-adde-3d2aef2ce60e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:57.073566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-36793527-a42f-4e6a-adde-3d2aef2ce60e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:57.074092 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-36793527-a42f-4e6a-adde-3d2aef2ce60e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:57.074935 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-36793527-a42f-4e6a-adde-3d2aef2ce60e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:57.075466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-36793527-a42f-4e6a-adde-3d2aef2ce60e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:57.127021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-79b71178-56c2-453c-87a9-63cf188f65ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:57.127672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-79b71178-56c2-453c-87a9-63cf188f65ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:57.134334 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-79b71178-56c2-453c-87a9-63cf188f65ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:57.134785 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-79b71178-56c2-453c-87a9-63cf188f65ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:57.135544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-79b71178-56c2-453c-87a9-63cf188f65ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:57.135983 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-79b71178-56c2-453c-87a9-63cf188f65ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:57.208288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-36793527-a42f-4e6a-adde-3d2aef2ce60e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:57.216542 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-36793527-a42f-4e6a-adde-3d2aef2ce60e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.154824 Jun 17 07:36:57.217055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 164/330] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:57 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:57.307611 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-79b71178-56c2-453c-87a9-63cf188f65ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:57.315174 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-79b71178-56c2-453c-87a9-63cf188f65ee tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.192219 Jun 17 07:36:57.315896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 167/331] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:57 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:36:58.233623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0f62d363-d93a-4614-b47e-43e93feb29aa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:58.234257 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0f62d363-d93a-4614-b47e-43e93feb29aa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:58.241467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f62d363-d93a-4614-b47e-43e93feb29aa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:58.242255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f62d363-d93a-4614-b47e-43e93feb29aa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:58.243277 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f62d363-d93a-4614-b47e-43e93feb29aa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:58.243956 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f62d363-d93a-4614-b47e-43e93feb29aa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:58.332821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ebdb2d06-5db6-4e06-a98f-2212e6ec2dc3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:58.333519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ebdb2d06-5db6-4e06-a98f-2212e6ec2dc3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:58.340153 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ebdb2d06-5db6-4e06-a98f-2212e6ec2dc3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:58.340757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ebdb2d06-5db6-4e06-a98f-2212e6ec2dc3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:58.341564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ebdb2d06-5db6-4e06-a98f-2212e6ec2dc3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:58.342000 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ebdb2d06-5db6-4e06-a98f-2212e6ec2dc3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:58.399925 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0f62d363-d93a-4614-b47e-43e93feb29aa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:58.410214 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0f62d363-d93a-4614-b47e-43e93feb29aa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.180134 Jun 17 07:36:58.423011 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 165/332] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:58 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:58.504633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ebdb2d06-5db6-4e06-a98f-2212e6ec2dc3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:58.512682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ebdb2d06-5db6-4e06-a98f-2212e6ec2dc3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.183990 Jun 17 07:36:58.513246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 168/333] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:58 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:59.431215 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b22ebb2e-d14a-4382-8e56-075d41822c10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:59.431839 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b22ebb2e-d14a-4382-8e56-075d41822c10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:59.438847 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b22ebb2e-d14a-4382-8e56-075d41822c10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:59.439300 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b22ebb2e-d14a-4382-8e56-075d41822c10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:59.440066 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b22ebb2e-d14a-4382-8e56-075d41822c10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:59.440509 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b22ebb2e-d14a-4382-8e56-075d41822c10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:59.535077 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-167d43ed-4064-4999-b522-92e5438c5db3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:36:59.535706 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-167d43ed-4064-4999-b522-92e5438c5db3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:36:59.542915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-167d43ed-4064-4999-b522-92e5438c5db3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:59.543321 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-167d43ed-4064-4999-b522-92e5438c5db3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:59.544313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-167d43ed-4064-4999-b522-92e5438c5db3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:36:59.544501 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-167d43ed-4064-4999-b522-92e5438c5db3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:36:59.581724 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b22ebb2e-d14a-4382-8e56-075d41822c10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:59.589351 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b22ebb2e-d14a-4382-8e56-075d41822c10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.162510 Jun 17 07:36:59.589925 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 166/334] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:59 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:36:59.694937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-167d43ed-4064-4999-b522-92e5438c5db3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:36:59.702533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-167d43ed-4064-4999-b522-92e5438c5db3 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.171314 Jun 17 07:36:59.703102 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 169/335] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:36:59 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:00.607717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fbcee2f8-93b9-4e8f-a5cb-252baf2701b6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:00.607717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fbcee2f8-93b9-4e8f-a5cb-252baf2701b6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:00.613496 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fbcee2f8-93b9-4e8f-a5cb-252baf2701b6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:00.613945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fbcee2f8-93b9-4e8f-a5cb-252baf2701b6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:00.614699 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fbcee2f8-93b9-4e8f-a5cb-252baf2701b6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:00.615689 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fbcee2f8-93b9-4e8f-a5cb-252baf2701b6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:00.719769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c632376b-157e-406e-bb9a-dab64b23e7e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:00.720450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c632376b-157e-406e-bb9a-dab64b23e7e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:00.726890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c632376b-157e-406e-bb9a-dab64b23e7e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:00.727336 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c632376b-157e-406e-bb9a-dab64b23e7e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:00.728100 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c632376b-157e-406e-bb9a-dab64b23e7e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:00.728532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c632376b-157e-406e-bb9a-dab64b23e7e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:00.757906 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fbcee2f8-93b9-4e8f-a5cb-252baf2701b6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:00.765521 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fbcee2f8-93b9-4e8f-a5cb-252baf2701b6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.162978 Jun 17 07:37:00.766107 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 167/336] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:00 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:00.859878 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c632376b-157e-406e-bb9a-dab64b23e7e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:00.867568 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c632376b-157e-406e-bb9a-dab64b23e7e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.151494 Jun 17 07:37:00.868127 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 170/337] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:00 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:01.782804 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b402823e-54d6-430f-9990-0defb423b0e1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:01.783404 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b402823e-54d6-430f-9990-0defb423b0e1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:01.790759 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b402823e-54d6-430f-9990-0defb423b0e1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:01.791203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b402823e-54d6-430f-9990-0defb423b0e1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:01.791952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b402823e-54d6-430f-9990-0defb423b0e1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:01.792375 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b402823e-54d6-430f-9990-0defb423b0e1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:01.884111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6d1b6fe8-2ca6-42c1-870f-b87de902344b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:01.884930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6d1b6fe8-2ca6-42c1-870f-b87de902344b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:01.891289 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6d1b6fe8-2ca6-42c1-870f-b87de902344b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:01.891832 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6d1b6fe8-2ca6-42c1-870f-b87de902344b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:01.892628 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6d1b6fe8-2ca6-42c1-870f-b87de902344b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:01.893052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6d1b6fe8-2ca6-42c1-870f-b87de902344b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:01.922209 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b402823e-54d6-430f-9990-0defb423b0e1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:01.929606 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b402823e-54d6-430f-9990-0defb423b0e1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.150516 Jun 17 07:37:01.930178 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 168/338] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:01 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:02.021823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6d1b6fe8-2ca6-42c1-870f-b87de902344b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:02.029089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6d1b6fe8-2ca6-42c1-870f-b87de902344b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.148963 Jun 17 07:37:02.029684 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 171/339] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:01 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:02.946663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c7cd8064-4f32-457b-89d6-c5410ac96f65 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:02.947433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c7cd8064-4f32-457b-89d6-c5410ac96f65 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:02.953875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c7cd8064-4f32-457b-89d6-c5410ac96f65 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:02.954323 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c7cd8064-4f32-457b-89d6-c5410ac96f65 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:02.958203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c7cd8064-4f32-457b-89d6-c5410ac96f65 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:02.958203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c7cd8064-4f32-457b-89d6-c5410ac96f65 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:02.962781 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-09545ea9-41bd-4c22-ad2b-e2ed66e7d81c req-2434edf0-1057-463a-b117-f566051e93a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8444090b-ae6f-4602-a407-fbc601de5625", "name": "network-vif-plugged", "status": "completed", "tag": "19c183bd-b52f-4034-8235-199f76f21ce8"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:02.971974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-09545ea9-41bd-4c22-ad2b-e2ed66e7d81c req-2434edf0-1057-463a-b117-f566051e93a8 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:02.972381 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-09545ea9-41bd-4c22-ad2b-e2ed66e7d81c req-2434edf0-1057-463a-b117-f566051e93a8 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:02.984344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-09545ea9-41bd-4c22-ad2b-e2ed66e7d81c req-2434edf0-1057-463a-b117-f566051e93a8 service nova] Creating event network-vif-plugged:19c183bd-b52f-4034-8235-199f76f21ce8 for instance 8444090b-ae6f-4602-a407-fbc601de5625 on hv-cinder-79733 Jun 17 07:37:02.989449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-09545ea9-41bd-4c22-ad2b-e2ed66e7d81c req-2434edf0-1057-463a-b117-f566051e93a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 Jun 17 07:37:02.990057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 172/340] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:37:03.047641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9043bf1c-1de2-4698-992f-baa61695a9a0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:03.048380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9043bf1c-1de2-4698-992f-baa61695a9a0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:03.055152 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9043bf1c-1de2-4698-992f-baa61695a9a0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:03.055599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9043bf1c-1de2-4698-992f-baa61695a9a0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:03.056357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9043bf1c-1de2-4698-992f-baa61695a9a0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:03.056786 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9043bf1c-1de2-4698-992f-baa61695a9a0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:03.091763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c7cd8064-4f32-457b-89d6-c5410ac96f65 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:03.099500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c7cd8064-4f32-457b-89d6-c5410ac96f65 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.156766 Jun 17 07:37:03.100255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 169/341] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:02 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:03.193705 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9043bf1c-1de2-4698-992f-baa61695a9a0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:03.201105 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9043bf1c-1de2-4698-992f-baa61695a9a0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.157651 Jun 17 07:37:03.201706 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 173/342] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:03 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:04.117101 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dab5dd90-d1cd-437e-a7fc-4d1fba42a6ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:04.117741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dab5dd90-d1cd-437e-a7fc-4d1fba42a6ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:04.119742 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=54 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:04.124608 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dab5dd90-d1cd-437e-a7fc-4d1fba42a6ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:04.125051 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dab5dd90-d1cd-437e-a7fc-4d1fba42a6ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:04.125820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dab5dd90-d1cd-437e-a7fc-4d1fba42a6ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:04.126248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dab5dd90-d1cd-437e-a7fc-4d1fba42a6ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:04.219794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4d5acbb0-f748-4a65-85bb-4e2236f196ce tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:04.220403 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4d5acbb0-f748-4a65-85bb-4e2236f196ce tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:04.226542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d5acbb0-f748-4a65-85bb-4e2236f196ce tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:04.226986 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d5acbb0-f748-4a65-85bb-4e2236f196ce tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:04.227755 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d5acbb0-f748-4a65-85bb-4e2236f196ce tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:04.228190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d5acbb0-f748-4a65-85bb-4e2236f196ce tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:04.257281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-dab5dd90-d1cd-437e-a7fc-4d1fba42a6ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:04.264696 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dab5dd90-d1cd-437e-a7fc-4d1fba42a6ff tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.151447 Jun 17 07:37:04.265280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 170/343] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:04 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:04.355225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4d5acbb0-f748-4a65-85bb-4e2236f196ce tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:04.362535 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4d5acbb0-f748-4a65-85bb-4e2236f196ce tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.146506 Jun 17 07:37:04.363101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 174/344] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:04 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:05.281091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ca27ea74-c098-4087-a978-63fc44c23ae4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:05.281714 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ca27ea74-c098-4087-a978-63fc44c23ae4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:05.289335 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca27ea74-c098-4087-a978-63fc44c23ae4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:05.289791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca27ea74-c098-4087-a978-63fc44c23ae4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:05.290551 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca27ea74-c098-4087-a978-63fc44c23ae4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:05.290982 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca27ea74-c098-4087-a978-63fc44c23ae4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:05.380405 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-99717b34-afda-4b0d-95d1-766db03a0d5c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:05.381558 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-99717b34-afda-4b0d-95d1-766db03a0d5c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:05.388508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-99717b34-afda-4b0d-95d1-766db03a0d5c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:05.389073 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-99717b34-afda-4b0d-95d1-766db03a0d5c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:05.391711 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-99717b34-afda-4b0d-95d1-766db03a0d5c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:05.392159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-99717b34-afda-4b0d-95d1-766db03a0d5c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:05.424424 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ca27ea74-c098-4087-a978-63fc44c23ae4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:05.434030 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ca27ea74-c098-4087-a978-63fc44c23ae4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.156744 Jun 17 07:37:05.434607 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 171/345] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:05 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:05.527782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-99717b34-afda-4b0d-95d1-766db03a0d5c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:05.535195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-99717b34-afda-4b0d-95d1-766db03a0d5c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1502 microversion: 2.1 time: 0.158957 Jun 17 07:37:05.535690 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 175/346] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:05 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:05.551796 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e5e1c9f-d9f5-40e7-8e4c-dd607216e2d9"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:05.553550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:05.559625 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:05.560088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:05.560918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:05.561267 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:05.583893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] HTTP exception thrown: Cannot 'attach_volume' instance e5abf359-6883-489c-b6bc-d6456efc857d while it is in vm_state rescued Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Request method failure captured: Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: POST /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d/os-volume_attachments HTTP/1.1 Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 74 Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC6HgW97DcVVe4zZ61jVJs6vqC6qVhgTTgpRZLuuUIvCMGWPsPvHURwju_GWPhbE2FTMvDkaV4jYSRQjzbnalfB7fA37jYPdA7b1XT9pj7nR03MzhEo5E5WEws7RJM_5lbiJWwsFyGl9Ass_D1fQkk_YzJmiXWio0Cd4ALAcqfvz0Hk Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:37:05.585820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 8b753148f55e4fb0897bf9639e8d4d70 Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {"volumeAttachment": {"volumeId": "8e5e1c9f-d9f5-40e7-8e4c-dd607216e2d9"}} Jun 17 07:37:05.587338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Cannot 'attach_volume' instance e5abf359-6883-489c-b6bc-d6456efc857d while it is in vm_state rescued Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'server_id': 'e5abf359-6883-489c-b6bc-d6456efc857d', 'body': {'volumeAttachment': {'volumeId': '8e5e1c9f-d9f5-40e7-8e4c-dd607216e2d9'}}} Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5abf359-6883-489c-b6bc-d6456efc857d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:37:05.588198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e5abf359-6883-489c-b6bc-d6456efc857d while it is in vm_state rescued Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:37:05.589758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:37:05.592049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:37:05.592049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:37:05.592049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e5abf359-6883-489c-b6bc-d6456efc857d while it is in vm_state rescued Jun 17 07:37:05.592049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:37:05.592049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Returning 409 to user: Cannot 'attach_volume' instance e5abf359-6883-489c-b6bc-d6456efc857d while it is in vm_state rescued {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:37:05.592049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d8c70fb3-83df-4503-b901-be27097dfd09 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039450 Jun 17 07:37:05.592049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 172/347] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:37:05 2022] POST /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 07:37:05.597069 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-58029780-197f-44db-838f-284feac49a5f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:05.597632 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-58029780-197f-44db-838f-284feac49a5f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:05.604298 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-58029780-197f-44db-838f-284feac49a5f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:05.604749 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-58029780-197f-44db-838f-284feac49a5f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:05.605547 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-58029780-197f-44db-838f-284feac49a5f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:05.605983 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-58029780-197f-44db-838f-284feac49a5f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:05.627941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:06.087404 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-58029780-197f-44db-838f-284feac49a5f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d/action" status: 202 len: 0 microversion: 2.1 time: 0.492612 Jun 17 07:37:06.088057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 176/348] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:37:05 2022] POST /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:37:06.098168 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ce400d93-7c83-4f63-94bf-88c244e531c9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:06.099104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ce400d93-7c83-4f63-94bf-88c244e531c9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:06.105824 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ce400d93-7c83-4f63-94bf-88c244e531c9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:06.106269 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ce400d93-7c83-4f63-94bf-88c244e531c9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:06.107033 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ce400d93-7c83-4f63-94bf-88c244e531c9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:06.107469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ce400d93-7c83-4f63-94bf-88c244e531c9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:06.260432 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ce400d93-7c83-4f63-94bf-88c244e531c9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:06.268508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ce400d93-7c83-4f63-94bf-88c244e531c9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1510 microversion: 2.1 time: 0.175489 Jun 17 07:37:06.269082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 173/349] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:06 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:06.454418 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8326c60e-4850-4ead-a23a-6cdb6fef930e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:06.455115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8326c60e-4850-4ead-a23a-6cdb6fef930e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:06.457920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=58 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:06.462802 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8326c60e-4850-4ead-a23a-6cdb6fef930e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:06.463247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8326c60e-4850-4ead-a23a-6cdb6fef930e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:06.464043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8326c60e-4850-4ead-a23a-6cdb6fef930e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:06.464483 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8326c60e-4850-4ead-a23a-6cdb6fef930e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:06.600338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8326c60e-4850-4ead-a23a-6cdb6fef930e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:06.606217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8326c60e-4850-4ead-a23a-6cdb6fef930e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.156000 Jun 17 07:37:06.606778 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 177/350] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:06 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:07.287414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-547296c8-8e4b-45ba-bf70-02e9baf737cb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:07.288039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-547296c8-8e4b-45ba-bf70-02e9baf737cb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:07.294473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-547296c8-8e4b-45ba-bf70-02e9baf737cb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:07.294912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-547296c8-8e4b-45ba-bf70-02e9baf737cb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:07.295663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-547296c8-8e4b-45ba-bf70-02e9baf737cb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:07.296088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-547296c8-8e4b-45ba-bf70-02e9baf737cb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:07.442810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-547296c8-8e4b-45ba-bf70-02e9baf737cb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:07.451131 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-547296c8-8e4b-45ba-bf70-02e9baf737cb tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1510 microversion: 2.1 time: 0.168023 Jun 17 07:37:07.451692 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 174/351] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:07 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:07.624024 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-05088c97-d266-4ab6-98ea-b392c7cb9027 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:07.624639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-05088c97-d266-4ab6-98ea-b392c7cb9027 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:07.630759 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05088c97-d266-4ab6-98ea-b392c7cb9027 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:07.631209 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05088c97-d266-4ab6-98ea-b392c7cb9027 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:07.632084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05088c97-d266-4ab6-98ea-b392c7cb9027 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:07.632570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05088c97-d266-4ab6-98ea-b392c7cb9027 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:07.761715 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-05088c97-d266-4ab6-98ea-b392c7cb9027 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:07.769004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-05088c97-d266-4ab6-98ea-b392c7cb9027 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1363 microversion: 2.1 time: 0.149445 Jun 17 07:37:07.769598 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 178/352] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:07 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:08.468428 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3714484f-525a-4cd0-9cf4-331f713f957a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:08.469028 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3714484f-525a-4cd0-9cf4-331f713f957a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:08.475532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3714484f-525a-4cd0-9cf4-331f713f957a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:08.475966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3714484f-525a-4cd0-9cf4-331f713f957a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:08.476712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3714484f-525a-4cd0-9cf4-331f713f957a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:08.477139 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3714484f-525a-4cd0-9cf4-331f713f957a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:08.612264 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3714484f-525a-4cd0-9cf4-331f713f957a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:08.621424 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3714484f-525a-4cd0-9cf4-331f713f957a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1510 microversion: 2.1 time: 0.156741 Jun 17 07:37:08.621993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 175/353] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:08 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:08.786416 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0f5235dc-222a-4849-b270-d18b79c2cc59 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:08.787028 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0f5235dc-222a-4849-b270-d18b79c2cc59 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:08.793423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f5235dc-222a-4849-b270-d18b79c2cc59 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:08.801440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f5235dc-222a-4849-b270-d18b79c2cc59 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:08.801440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f5235dc-222a-4849-b270-d18b79c2cc59 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:08.801440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f5235dc-222a-4849-b270-d18b79c2cc59 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:09.136196 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0f5235dc-222a-4849-b270-d18b79c2cc59 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:09.143647 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0f5235dc-222a-4849-b270-d18b79c2cc59 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1550 microversion: 2.1 time: 0.361218 Jun 17 07:37:09.144211 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 179/354] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:08 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1550 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:09.160415 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-365b1ad7-0675-458f-afd9-dea341a5b989 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:09.160910 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-365b1ad7-0675-458f-afd9-dea341a5b989 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:09.167449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-365b1ad7-0675-458f-afd9-dea341a5b989 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:09.167899 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-365b1ad7-0675-458f-afd9-dea341a5b989 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:09.168663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-365b1ad7-0675-458f-afd9-dea341a5b989 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:09.169098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-365b1ad7-0675-458f-afd9-dea341a5b989 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:09.246967 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-365b1ad7-0675-458f-afd9-dea341a5b989 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090475 Jun 17 07:37:09.250855 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 176/355] 10.222.0.52 () {58 vars in 1274 bytes} [Fri Jun 17 07:37:09 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:37:09.638905 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-994baaff-c99b-4aec-8745-8c10bdf5bcef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:09.639521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-994baaff-c99b-4aec-8745-8c10bdf5bcef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:09.653925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-994baaff-c99b-4aec-8745-8c10bdf5bcef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:09.653925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-994baaff-c99b-4aec-8745-8c10bdf5bcef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:09.653925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-994baaff-c99b-4aec-8745-8c10bdf5bcef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:09.653925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-994baaff-c99b-4aec-8745-8c10bdf5bcef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:09.786769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-994baaff-c99b-4aec-8745-8c10bdf5bcef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:09.796568 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-994baaff-c99b-4aec-8745-8c10bdf5bcef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1510 microversion: 2.1 time: 0.161543 Jun 17 07:37:09.797233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 180/356] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:09 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:10.544918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-8095d925-d910-46aa-b444-46acb013e80b req-a43f5984-19e7-4275-b4ec-67a215e55953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8444090b-ae6f-4602-a407-fbc601de5625", "tag": "19c183bd-b52f-4034-8235-199f76f21ce8"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:10.553099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-8095d925-d910-46aa-b444-46acb013e80b req-a43f5984-19e7-4275-b4ec-67a215e55953 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:10.553609 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-8095d925-d910-46aa-b444-46acb013e80b req-a43f5984-19e7-4275-b4ec-67a215e55953 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:10.565420 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-8095d925-d910-46aa-b444-46acb013e80b req-a43f5984-19e7-4275-b4ec-67a215e55953 service nova] Creating event network-changed:19c183bd-b52f-4034-8235-199f76f21ce8 for instance 8444090b-ae6f-4602-a407-fbc601de5625 on hv-cinder-79733 Jun 17 07:37:10.571618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-8095d925-d910-46aa-b444-46acb013e80b req-a43f5984-19e7-4275-b4ec-67a215e55953 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030739 Jun 17 07:37:10.572189 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 177/357] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:37:10.816137 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f095da31-fe35-462c-a2bf-f4d529d10fad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:10.816746 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f095da31-fe35-462c-a2bf-f4d529d10fad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:10.823640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f095da31-fe35-462c-a2bf-f4d529d10fad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:10.824167 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f095da31-fe35-462c-a2bf-f4d529d10fad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:10.825218 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f095da31-fe35-462c-a2bf-f4d529d10fad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:10.825689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f095da31-fe35-462c-a2bf-f4d529d10fad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:10.965944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f095da31-fe35-462c-a2bf-f4d529d10fad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:10.973408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f095da31-fe35-462c-a2bf-f4d529d10fad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1510 microversion: 2.1 time: 0.161251 Jun 17 07:37:10.974182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 181/358] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:10 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:11.994183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9a6a184b-e924-4724-a320-19a983f5eb20 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:11.994183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9a6a184b-e924-4724-a320-19a983f5eb20 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:11.999658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a6a184b-e924-4724-a320-19a983f5eb20 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:12.000099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a6a184b-e924-4724-a320-19a983f5eb20 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:12.000906 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a6a184b-e924-4724-a320-19a983f5eb20 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:12.001357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a6a184b-e924-4724-a320-19a983f5eb20 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:12.134829 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9a6a184b-e924-4724-a320-19a983f5eb20 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:12.142588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9a6a184b-e924-4724-a320-19a983f5eb20 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1516 microversion: 2.1 time: 0.155351 Jun 17 07:37:12.145565 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 178/359] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:11 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:12.149834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-733fc0a0-da39-4a93-8803-29b78daca967 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b413880-8d1a-4d6b-9d07-f63315fdae89", "device": "/dev/sdb"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:12.151386 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-733fc0a0-da39-4a93-8803-29b78daca967 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:12.158107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-733fc0a0-da39-4a93-8803-29b78daca967 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:12.158566 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-733fc0a0-da39-4a93-8803-29b78daca967 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:12.159321 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-733fc0a0-da39-4a93-8803-29b78daca967 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:12.159747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-733fc0a0-da39-4a93-8803-29b78daca967 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:13.199806 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-733fc0a0-da39-4a93-8803-29b78daca967 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "POST /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.054769 Jun 17 07:37:13.200607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 182/360] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:37:12 2022] POST /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54/os-volume_attachments => generated 194 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:37:15.248208 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-05e93655-0e57-4032-8aee-6f5d8e90f5d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'create', calling method: .version_select at 0x7fb069e153a0>, body: {"keypair": {"name": "tempest-keypair-1433800131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbaF4UnZ0/EpInM/plIbYEEjT5w90fYQZJ2l5VruyEZ5ppoZvgwMB95UKsnJYRbQ8xXtdsTtf+WhzN4ffzu78QhjvzEQFKrEQY9x7JOs8YP5NQz8cetPjZOKewW0029Tg=="}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:15.263540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-05e93655-0e57-4032-8aee-6f5d8e90f5d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Getting quotas for project 94fc753fb51e41acb3037d2ca7cd1394. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:37:15.267423 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-05e93655-0e57-4032-8aee-6f5d8e90f5d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Getting quotas for user 8b753148f55e4fb0897bf9639e8d4d70 and project 94fc753fb51e41acb3037d2ca7cd1394. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:37:15.407002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-05e93655-0e57-4032-8aee-6f5d8e90f5d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162929 Jun 17 07:37:15.407599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 179/361] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:37:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:37:17.935561 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-741125854", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "315e52c5-a70d-404e-b206-282d7a7fd5b1"}], "security_groups": [{"name": "tempest-securitygroup--1171668555"}], "key_name": "tempest-keypair-1433800131", "user_data": "}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:18.058126 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] validate_networks() for [('315e52c5-a70d-404e-b206-282d7a7fd5b1', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:37:18.496261 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:37:18.496706 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:37:18.497194 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:37:18.499969 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:37:18.500384 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:37:18.509955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:18.510397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:18.512021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:18.512508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:18.536132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Getting quotas for project 94fc753fb51e41acb3037d2ca7cd1394. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:37:18.536132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Getting quotas for user 8b753148f55e4fb0897bf9639e8d4d70 and project 94fc753fb51e41acb3037d2ca7cd1394. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:37:18.547646 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:37:18.550079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:37:18.721422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-31231511-e2d6-47bf-a30c-c61544590ea6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.787824 Jun 17 07:37:18.721422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 183/362] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:37:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:37:18.731526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-600f2c2a-e6e7-49f1-8e95-4891cf47384e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:18.732136 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-600f2c2a-e6e7-49f1-8e95-4891cf47384e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:18.795187 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-600f2c2a-e6e7-49f1-8e95-4891cf47384e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:18.803632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-600f2c2a-e6e7-49f1-8e95-4891cf47384e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1245 microversion: 2.1 time: 0.076257 Jun 17 07:37:18.803632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 180/363] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:18 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:19.818979 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1c4d70ef-080d-4007-9668-1f48f8401142 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:19.819771 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1c4d70ef-080d-4007-9668-1f48f8401142 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:19.826174 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1c4d70ef-080d-4007-9668-1f48f8401142 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:19.826647 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1c4d70ef-080d-4007-9668-1f48f8401142 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:19.827459 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1c4d70ef-080d-4007-9668-1f48f8401142 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:19.827881 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1c4d70ef-080d-4007-9668-1f48f8401142 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:19.896520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1c4d70ef-080d-4007-9668-1f48f8401142 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:19.904386 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1c4d70ef-080d-4007-9668-1f48f8401142 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1249 microversion: 2.1 time: 0.089669 Jun 17 07:37:19.905178 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 184/364] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:19 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:20.922343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e3644ed9-c154-421d-a7ac-4eee8909f1ad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:20.922937 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e3644ed9-c154-421d-a7ac-4eee8909f1ad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:20.930509 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e3644ed9-c154-421d-a7ac-4eee8909f1ad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:20.930995 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e3644ed9-c154-421d-a7ac-4eee8909f1ad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:20.931857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e3644ed9-c154-421d-a7ac-4eee8909f1ad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:20.932339 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e3644ed9-c154-421d-a7ac-4eee8909f1ad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:20.994055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e3644ed9-c154-421d-a7ac-4eee8909f1ad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:21.001766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e3644ed9-c154-421d-a7ac-4eee8909f1ad tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1249 microversion: 2.1 time: 0.083203 Jun 17 07:37:21.002323 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 181/365] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:20 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:22.018418 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6c3085e3-bbd8-46d3-940d-3837d5a7a6fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:22.019017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6c3085e3-bbd8-46d3-940d-3837d5a7a6fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:22.033142 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6c3085e3-bbd8-46d3-940d-3837d5a7a6fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:22.034919 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6c3085e3-bbd8-46d3-940d-3837d5a7a6fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:22.035695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6c3085e3-bbd8-46d3-940d-3837d5a7a6fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:22.036122 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6c3085e3-bbd8-46d3-940d-3837d5a7a6fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:22.099765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6c3085e3-bbd8-46d3-940d-3837d5a7a6fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:22.108800 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6c3085e3-bbd8-46d3-940d-3837d5a7a6fe tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1249 microversion: 2.1 time: 0.094474 Jun 17 07:37:22.116833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 185/366] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:22 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:23.125777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-51aaf5a7-5aca-4770-9025-a0d8f5a433e4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:23.126396 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-51aaf5a7-5aca-4770-9025-a0d8f5a433e4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:23.132844 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51aaf5a7-5aca-4770-9025-a0d8f5a433e4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:23.133287 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51aaf5a7-5aca-4770-9025-a0d8f5a433e4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:23.134121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51aaf5a7-5aca-4770-9025-a0d8f5a433e4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:23.134865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51aaf5a7-5aca-4770-9025-a0d8f5a433e4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:23.149385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:23.197511 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-51aaf5a7-5aca-4770-9025-a0d8f5a433e4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:23.205099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-51aaf5a7-5aca-4770-9025-a0d8f5a433e4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1249 microversion: 2.1 time: 0.083086 Jun 17 07:37:23.205711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 182/367] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:23 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:24.222690 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-be294e01-e8e3-41fc-b995-93f57c27ef19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:24.223207 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-be294e01-e8e3-41fc-b995-93f57c27ef19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:24.230036 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-be294e01-e8e3-41fc-b995-93f57c27ef19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:24.230478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-be294e01-e8e3-41fc-b995-93f57c27ef19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:24.231231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-be294e01-e8e3-41fc-b995-93f57c27ef19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:24.231687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-be294e01-e8e3-41fc-b995-93f57c27ef19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:24.298599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-be294e01-e8e3-41fc-b995-93f57c27ef19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:24.306502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-be294e01-e8e3-41fc-b995-93f57c27ef19 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1241 microversion: 2.1 time: 0.087185 Jun 17 07:37:24.307055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 186/368] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:24 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:25.323552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-392b0504-af17-4e9d-80bc-899159586c88 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:25.325096 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-392b0504-af17-4e9d-80bc-899159586c88 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:25.333024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-392b0504-af17-4e9d-80bc-899159586c88 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:25.333649 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-392b0504-af17-4e9d-80bc-899159586c88 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:25.334464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-392b0504-af17-4e9d-80bc-899159586c88 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:25.334903 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-392b0504-af17-4e9d-80bc-899159586c88 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:25.398401 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-392b0504-af17-4e9d-80bc-899159586c88 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:25.406833 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-392b0504-af17-4e9d-80bc-899159586c88 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1241 microversion: 2.1 time: 0.087180 Jun 17 07:37:25.407439 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 183/369] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:25 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:26.424826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-354c0525-0f56-41e5-9175-7008d9226809 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:26.425509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-354c0525-0f56-41e5-9175-7008d9226809 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:26.432081 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-354c0525-0f56-41e5-9175-7008d9226809 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:26.432526 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-354c0525-0f56-41e5-9175-7008d9226809 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:26.433274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-354c0525-0f56-41e5-9175-7008d9226809 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:26.433732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-354c0525-0f56-41e5-9175-7008d9226809 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:26.514649 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-354c0525-0f56-41e5-9175-7008d9226809 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:26.524631 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-354c0525-0f56-41e5-9175-7008d9226809 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1297 microversion: 2.1 time: 0.103662 Jun 17 07:37:26.525133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 187/370] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:26 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:27.541772 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-13500a1e-cd39-4d78-b92e-55a3a0e93f87 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:27.543407 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-13500a1e-cd39-4d78-b92e-55a3a0e93f87 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:27.548965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-13500a1e-cd39-4d78-b92e-55a3a0e93f87 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:27.549442 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-13500a1e-cd39-4d78-b92e-55a3a0e93f87 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:27.550383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-13500a1e-cd39-4d78-b92e-55a3a0e93f87 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:27.551133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-13500a1e-cd39-4d78-b92e-55a3a0e93f87 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:27.619746 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-13500a1e-cd39-4d78-b92e-55a3a0e93f87 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:27.627317 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-13500a1e-cd39-4d78-b92e-55a3a0e93f87 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1303 microversion: 2.1 time: 0.089301 Jun 17 07:37:27.628159 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 184/371] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:27 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:28.648581 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-dadc3efb-f292-45f0-a3c3-3bcd732d1f94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:28.650183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-dadc3efb-f292-45f0-a3c3-3bcd732d1f94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:28.654569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:28.655519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:28.659377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-dadc3efb-f292-45f0-a3c3-3bcd732d1f94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:28.659835 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-dadc3efb-f292-45f0-a3c3-3bcd732d1f94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:28.660606 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-dadc3efb-f292-45f0-a3c3-3bcd732d1f94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:28.661216 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-dadc3efb-f292-45f0-a3c3-3bcd732d1f94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:28.843989 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-dadc3efb-f292-45f0-a3c3-3bcd732d1f94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:28.851521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-dadc3efb-f292-45f0-a3c3-3bcd732d1f94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.210553 Jun 17 07:37:28.857741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 188/372] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:28 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:29.000912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-522242b3-3c57-4a4e-b56e-c1ba8b652273 req-01e26df5-1ade-439b-a42d-cc3f4a78c311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1866c92-f2f4-49e4-b391-ffca4b0ce35b", "tag": "1cbd5884-4ecf-4e5b-8a71-19880b70a371"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:29.007170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=6 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:29.014765 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-522242b3-3c57-4a4e-b56e-c1ba8b652273 req-01e26df5-1ade-439b-a42d-cc3f4a78c311 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:29.015437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-522242b3-3c57-4a4e-b56e-c1ba8b652273 req-01e26df5-1ade-439b-a42d-cc3f4a78c311 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:29.029635 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-522242b3-3c57-4a4e-b56e-c1ba8b652273 req-01e26df5-1ade-439b-a42d-cc3f4a78c311 service nova] Creating event network-changed:1cbd5884-4ecf-4e5b-8a71-19880b70a371 for instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b on hv-cinder-79733 Jun 17 07:37:29.034863 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-522242b3-3c57-4a4e-b56e-c1ba8b652273 req-01e26df5-1ade-439b-a42d-cc3f4a78c311 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040622 Jun 17 07:37:29.035475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 185/373] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:37:29.867812 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b8b13d7e-0adf-40b7-b399-3b3e2873e494 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:29.868475 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b8b13d7e-0adf-40b7-b399-3b3e2873e494 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:29.876937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b8b13d7e-0adf-40b7-b399-3b3e2873e494 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:29.877405 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b8b13d7e-0adf-40b7-b399-3b3e2873e494 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:29.881820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b8b13d7e-0adf-40b7-b399-3b3e2873e494 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:29.881820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b8b13d7e-0adf-40b7-b399-3b3e2873e494 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:30.018214 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b8b13d7e-0adf-40b7-b399-3b3e2873e494 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:30.026223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b8b13d7e-0adf-40b7-b399-3b3e2873e494 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.162017 Jun 17 07:37:30.026946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 189/374] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:29 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:31.045499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c17fc100-bd2a-4a39-9730-6c40ae959027 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:31.046196 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c17fc100-bd2a-4a39-9730-6c40ae959027 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:31.052409 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c17fc100-bd2a-4a39-9730-6c40ae959027 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:31.052856 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c17fc100-bd2a-4a39-9730-6c40ae959027 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:31.053650 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c17fc100-bd2a-4a39-9730-6c40ae959027 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:31.054083 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c17fc100-bd2a-4a39-9730-6c40ae959027 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:31.186453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c17fc100-bd2a-4a39-9730-6c40ae959027 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:31.193861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c17fc100-bd2a-4a39-9730-6c40ae959027 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.153895 Jun 17 07:37:31.194429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 186/375] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:31 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:32.220716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f9475f1d-98c4-4a2f-b4d8-790d5df8607c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:32.221237 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f9475f1d-98c4-4a2f-b4d8-790d5df8607c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:32.227733 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f9475f1d-98c4-4a2f-b4d8-790d5df8607c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:32.228184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f9475f1d-98c4-4a2f-b4d8-790d5df8607c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:32.228938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f9475f1d-98c4-4a2f-b4d8-790d5df8607c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:32.229397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f9475f1d-98c4-4a2f-b4d8-790d5df8607c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:32.356500 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f9475f1d-98c4-4a2f-b4d8-790d5df8607c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:32.364151 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f9475f1d-98c4-4a2f-b4d8-790d5df8607c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.147511 Jun 17 07:37:32.364716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 190/376] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:32 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:33.381169 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c1a9a750-55dd-4ded-8d82-23d61dc078db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:33.381921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c1a9a750-55dd-4ded-8d82-23d61dc078db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:33.389749 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c1a9a750-55dd-4ded-8d82-23d61dc078db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:33.390528 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c1a9a750-55dd-4ded-8d82-23d61dc078db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:33.391569 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c1a9a750-55dd-4ded-8d82-23d61dc078db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:33.392019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c1a9a750-55dd-4ded-8d82-23d61dc078db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:33.534056 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c1a9a750-55dd-4ded-8d82-23d61dc078db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:33.541793 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c1a9a750-55dd-4ded-8d82-23d61dc078db tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.164679 Jun 17 07:37:33.542385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 187/377] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:33 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:34.559199 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fcb7c42d-726b-4ed1-a3b6-eb267d374ba6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:34.559865 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fcb7c42d-726b-4ed1-a3b6-eb267d374ba6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:34.566233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fcb7c42d-726b-4ed1-a3b6-eb267d374ba6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:34.566669 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fcb7c42d-726b-4ed1-a3b6-eb267d374ba6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:34.567425 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fcb7c42d-726b-4ed1-a3b6-eb267d374ba6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:34.567847 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fcb7c42d-726b-4ed1-a3b6-eb267d374ba6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:34.586784 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:34.704890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fcb7c42d-726b-4ed1-a3b6-eb267d374ba6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:34.712694 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fcb7c42d-726b-4ed1-a3b6-eb267d374ba6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.157370 Jun 17 07:37:34.713266 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 191/378] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:34 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:35.223638 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-919846161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1192281260", "security_groups": [{"name": "tempest-secgroup-smoke-962214724"}], "block_device_mapping_v2": [{"uuid": "33e53cfc-bc2a-4639-b5e1-73b799458ac7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "156b13e9-64a4-4462-8a1a-126909d8e3f9"}]}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:37:35.232511 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:35.334949 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] validate_networks() for [('156b13e9-64a4-4462-8a1a-126909d8e3f9', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:37:35.731753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-38392b9b-7482-4121-a0b7-5bc92c734193 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:35.732391 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-38392b9b-7482-4121-a0b7-5bc92c734193 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:35.739354 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38392b9b-7482-4121-a0b7-5bc92c734193 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:35.739803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38392b9b-7482-4121-a0b7-5bc92c734193 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:35.740582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38392b9b-7482-4121-a0b7-5bc92c734193 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:35.741018 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38392b9b-7482-4121-a0b7-5bc92c734193 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:35.748790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:37:35.751499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:37:35.751499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:37:35.751499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:37:35.751499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:37:35.760115 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:35.760556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:35.761374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:35.761814 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:35.781194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Getting quotas for project 8705999014cf43e1b1ccd5186b67b4bd. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:37:35.787108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Getting quotas for user 781e29f49f27417a96cfc4ba00af95dd and project 8705999014cf43e1b1ccd5186b67b4bd. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:37:35.847413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:37:35.849549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33e53cfc-bc2a-4639-b5e1-73b799458ac7',volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:37:35.883362 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-38392b9b-7482-4121-a0b7-5bc92c734193 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:35.891515 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-38392b9b-7482-4121-a0b7-5bc92c734193 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.164819 Jun 17 07:37:35.892092 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 192/379] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:35 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:36.318572 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f149970c-7be3-4019-b201-f4c3b9af047d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.098662 Jun 17 07:37:36.319148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 188/380] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:37:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:37:36.329711 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8ab96d52-544f-41b3-87a8-90f5067f0fa5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:36.330321 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8ab96d52-544f-41b3-87a8-90f5067f0fa5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:36.399001 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8ab96d52-544f-41b3-87a8-90f5067f0fa5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:36.406586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8ab96d52-544f-41b3-87a8-90f5067f0fa5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1094 microversion: 2.1 time: 0.080891 Jun 17 07:37:36.407159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 193/381] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:36 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:36.909046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-224546d0-63df-4d7b-9282-4a6c482308f6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:36.909677 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-224546d0-63df-4d7b-9282-4a6c482308f6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:36.916250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-224546d0-63df-4d7b-9282-4a6c482308f6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:36.916708 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-224546d0-63df-4d7b-9282-4a6c482308f6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:36.917473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-224546d0-63df-4d7b-9282-4a6c482308f6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:36.917904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-224546d0-63df-4d7b-9282-4a6c482308f6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:37.053800 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-224546d0-63df-4d7b-9282-4a6c482308f6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:37.062796 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-224546d0-63df-4d7b-9282-4a6c482308f6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.157523 Jun 17 07:37:37.071711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 189/382] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:36 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:37.423277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-16e05740-1403-4979-8939-3b45b428d28a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:37.424444 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-16e05740-1403-4979-8939-3b45b428d28a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:37.427339 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:37.480357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-16e05740-1403-4979-8939-3b45b428d28a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:37.487706 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-16e05740-1403-4979-8939-3b45b428d28a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1094 microversion: 2.1 time: 0.068473 Jun 17 07:37:37.488283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 194/383] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:37 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:38.087951 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9d2e47f1-051f-4e50-ab16-2cdce4fc9bd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:38.088560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9d2e47f1-051f-4e50-ab16-2cdce4fc9bd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:38.095970 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d2e47f1-051f-4e50-ab16-2cdce4fc9bd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:38.096420 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d2e47f1-051f-4e50-ab16-2cdce4fc9bd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:38.097173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d2e47f1-051f-4e50-ab16-2cdce4fc9bd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:38.097646 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d2e47f1-051f-4e50-ab16-2cdce4fc9bd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:38.243890 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9d2e47f1-051f-4e50-ab16-2cdce4fc9bd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:38.252810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9d2e47f1-051f-4e50-ab16-2cdce4fc9bd0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.168388 Jun 17 07:37:38.253847 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 190/384] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:38 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:38.505181 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a91b2219-af69-4063-834e-7d17d5b795e2 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:38.505754 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a91b2219-af69-4063-834e-7d17d5b795e2 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:38.513134 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a91b2219-af69-4063-834e-7d17d5b795e2 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:38.513596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a91b2219-af69-4063-834e-7d17d5b795e2 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:38.514344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a91b2219-af69-4063-834e-7d17d5b795e2 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:38.514769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a91b2219-af69-4063-834e-7d17d5b795e2 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:38.579834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a91b2219-af69-4063-834e-7d17d5b795e2 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:38.587360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a91b2219-af69-4063-834e-7d17d5b795e2 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.085988 Jun 17 07:37:38.587916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 195/385] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:38 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:39.273058 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f048c44a-e3f3-4c2e-ac5d-cd12541e7b80 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:39.273699 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f048c44a-e3f3-4c2e-ac5d-cd12541e7b80 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:39.280127 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f048c44a-e3f3-4c2e-ac5d-cd12541e7b80 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:39.280603 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f048c44a-e3f3-4c2e-ac5d-cd12541e7b80 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:39.281367 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f048c44a-e3f3-4c2e-ac5d-cd12541e7b80 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:39.281793 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f048c44a-e3f3-4c2e-ac5d-cd12541e7b80 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:39.416557 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f048c44a-e3f3-4c2e-ac5d-cd12541e7b80 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:39.424017 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f048c44a-e3f3-4c2e-ac5d-cd12541e7b80 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.156031 Jun 17 07:37:39.424579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 191/386] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:39 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:39.604680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f728d3fd-b81d-4a65-9226-ccedebd7409d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:39.608527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f728d3fd-b81d-4a65-9226-ccedebd7409d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:39.612180 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f728d3fd-b81d-4a65-9226-ccedebd7409d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:39.612620 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f728d3fd-b81d-4a65-9226-ccedebd7409d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:39.613397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f728d3fd-b81d-4a65-9226-ccedebd7409d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:39.613827 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f728d3fd-b81d-4a65-9226-ccedebd7409d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:39.674164 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f728d3fd-b81d-4a65-9226-ccedebd7409d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:39.682162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f728d3fd-b81d-4a65-9226-ccedebd7409d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.081188 Jun 17 07:37:39.682823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 196/387] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:39 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:40.442732 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7e222c43-fca7-4afc-af7d-7a50709d3abd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:40.443645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7e222c43-fca7-4afc-af7d-7a50709d3abd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:40.450941 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7e222c43-fca7-4afc-af7d-7a50709d3abd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:40.451308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7e222c43-fca7-4afc-af7d-7a50709d3abd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:40.452091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7e222c43-fca7-4afc-af7d-7a50709d3abd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:40.452516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7e222c43-fca7-4afc-af7d-7a50709d3abd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:40.583076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7e222c43-fca7-4afc-af7d-7a50709d3abd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:40.591340 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7e222c43-fca7-4afc-af7d-7a50709d3abd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.154795 Jun 17 07:37:40.592000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 192/388] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:40 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:40.699894 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6bfd808b-68b9-45f1-9bd4-a1add7a9e62f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:40.700510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6bfd808b-68b9-45f1-9bd4-a1add7a9e62f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:40.707189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6bfd808b-68b9-45f1-9bd4-a1add7a9e62f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:40.707585 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6bfd808b-68b9-45f1-9bd4-a1add7a9e62f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:40.708351 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6bfd808b-68b9-45f1-9bd4-a1add7a9e62f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:40.708735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6bfd808b-68b9-45f1-9bd4-a1add7a9e62f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:40.771262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6bfd808b-68b9-45f1-9bd4-a1add7a9e62f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:40.779018 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6bfd808b-68b9-45f1-9bd4-a1add7a9e62f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.083026 Jun 17 07:37:40.779582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 197/389] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:40 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:41.614662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d9326197-5b05-429b-93f0-13b8cc26f836 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:41.615202 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d9326197-5b05-429b-93f0-13b8cc26f836 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:41.621975 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9326197-5b05-429b-93f0-13b8cc26f836 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:41.622411 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9326197-5b05-429b-93f0-13b8cc26f836 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:41.623168 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9326197-5b05-429b-93f0-13b8cc26f836 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:41.623594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9326197-5b05-429b-93f0-13b8cc26f836 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:41.754070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d9326197-5b05-429b-93f0-13b8cc26f836 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:41.761941 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d9326197-5b05-429b-93f0-13b8cc26f836 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.150831 Jun 17 07:37:41.762543 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 193/390] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:41 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:41.796216 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c3c7021d-34dd-4a81-873b-f39de5ae9cc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:41.796822 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c3c7021d-34dd-4a81-873b-f39de5ae9cc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:41.803206 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c3c7021d-34dd-4a81-873b-f39de5ae9cc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:41.803640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c3c7021d-34dd-4a81-873b-f39de5ae9cc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:41.804382 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c3c7021d-34dd-4a81-873b-f39de5ae9cc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:41.804807 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c3c7021d-34dd-4a81-873b-f39de5ae9cc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:41.864873 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c3c7021d-34dd-4a81-873b-f39de5ae9cc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:41.872654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c3c7021d-34dd-4a81-873b-f39de5ae9cc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.080914 Jun 17 07:37:41.873210 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 198/391] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:41 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:42.781803 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ecd52e6a-08a1-48ba-aedc-8c99d10d460f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:42.782440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ecd52e6a-08a1-48ba-aedc-8c99d10d460f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:42.788939 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ecd52e6a-08a1-48ba-aedc-8c99d10d460f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:42.794124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ecd52e6a-08a1-48ba-aedc-8c99d10d460f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:42.794124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ecd52e6a-08a1-48ba-aedc-8c99d10d460f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:42.794124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ecd52e6a-08a1-48ba-aedc-8c99d10d460f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:42.889432 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-722a52e8-d8a3-46ba-91c4-14de8abcca49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:42.890046 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-722a52e8-d8a3-46ba-91c4-14de8abcca49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:42.896214 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-722a52e8-d8a3-46ba-91c4-14de8abcca49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:42.896650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-722a52e8-d8a3-46ba-91c4-14de8abcca49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:42.897531 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-722a52e8-d8a3-46ba-91c4-14de8abcca49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:42.897992 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-722a52e8-d8a3-46ba-91c4-14de8abcca49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:42.934760 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ecd52e6a-08a1-48ba-aedc-8c99d10d460f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:42.942568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ecd52e6a-08a1-48ba-aedc-8c99d10d460f tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.164730 Jun 17 07:37:42.943159 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 194/392] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:42 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:42.974231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-722a52e8-d8a3-46ba-91c4-14de8abcca49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:42.982775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-722a52e8-d8a3-46ba-91c4-14de8abcca49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.097387 Jun 17 07:37:42.983348 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 199/393] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:42 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:43.959681 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-db3fa2a8-f209-4c7d-b54b-e990e3a4708e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:43.960234 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-db3fa2a8-f209-4c7d-b54b-e990e3a4708e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:43.967399 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-db3fa2a8-f209-4c7d-b54b-e990e3a4708e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:43.967843 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-db3fa2a8-f209-4c7d-b54b-e990e3a4708e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:43.968606 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-db3fa2a8-f209-4c7d-b54b-e990e3a4708e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:43.969036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-db3fa2a8-f209-4c7d-b54b-e990e3a4708e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:44.000020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a7d0a008-3e78-4c78-8b0a-ce075e32d8b0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:44.000719 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a7d0a008-3e78-4c78-8b0a-ce075e32d8b0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:44.007221 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a7d0a008-3e78-4c78-8b0a-ce075e32d8b0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:44.007658 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a7d0a008-3e78-4c78-8b0a-ce075e32d8b0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:44.008411 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a7d0a008-3e78-4c78-8b0a-ce075e32d8b0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:44.008838 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a7d0a008-3e78-4c78-8b0a-ce075e32d8b0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:44.071115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a7d0a008-3e78-4c78-8b0a-ce075e32d8b0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:44.078953 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a7d0a008-3e78-4c78-8b0a-ce075e32d8b0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.082727 Jun 17 07:37:44.079709 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 200/394] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:43 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:44.101526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-db3fa2a8-f209-4c7d-b54b-e990e3a4708e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:44.110139 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-db3fa2a8-f209-4c7d-b54b-e990e3a4708e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.154489 Jun 17 07:37:44.110707 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 195/395] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:43 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:45.095826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9fe71183-ab87-4760-9dbb-b65abdc2222f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:45.096577 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9fe71183-ab87-4760-9dbb-b65abdc2222f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:45.109528 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9fe71183-ab87-4760-9dbb-b65abdc2222f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:45.110453 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9fe71183-ab87-4760-9dbb-b65abdc2222f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:45.111657 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9fe71183-ab87-4760-9dbb-b65abdc2222f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:45.112416 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9fe71183-ab87-4760-9dbb-b65abdc2222f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:45.128026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c2b8c8b1-5f07-48e2-81eb-c949b7ec2188 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:45.128629 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c2b8c8b1-5f07-48e2-81eb-c949b7ec2188 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:45.135246 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2b8c8b1-5f07-48e2-81eb-c949b7ec2188 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:45.135946 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2b8c8b1-5f07-48e2-81eb-c949b7ec2188 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:45.137809 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2b8c8b1-5f07-48e2-81eb-c949b7ec2188 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:45.138247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2b8c8b1-5f07-48e2-81eb-c949b7ec2188 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:45.179257 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9fe71183-ab87-4760-9dbb-b65abdc2222f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:45.186725 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9fe71183-ab87-4760-9dbb-b65abdc2222f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.094710 Jun 17 07:37:45.187304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 201/396] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:45 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:45.277104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c2b8c8b1-5f07-48e2-81eb-c949b7ec2188 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:45.284891 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c2b8c8b1-5f07-48e2-81eb-c949b7ec2188 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.160586 Jun 17 07:37:45.285560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 196/397] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:45 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:46.203031 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e13cfea6-9a78-4c85-882e-89e60e3f37a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:46.203633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e13cfea6-9a78-4c85-882e-89e60e3f37a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:46.210203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e13cfea6-9a78-4c85-882e-89e60e3f37a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:46.210638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e13cfea6-9a78-4c85-882e-89e60e3f37a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:46.211407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e13cfea6-9a78-4c85-882e-89e60e3f37a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:46.211842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e13cfea6-9a78-4c85-882e-89e60e3f37a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:46.274727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e13cfea6-9a78-4c85-882e-89e60e3f37a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:46.282597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e13cfea6-9a78-4c85-882e-89e60e3f37a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.083654 Jun 17 07:37:46.283164 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 202/398] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:46 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:46.303645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8d9631e7-a468-445e-880e-fc928e6425fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:46.304777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8d9631e7-a468-445e-880e-fc928e6425fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:46.307833 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:46.309018 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=6 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:46.316460 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d9631e7-a468-445e-880e-fc928e6425fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:46.316954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d9631e7-a468-445e-880e-fc928e6425fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:46.319354 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d9631e7-a468-445e-880e-fc928e6425fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:46.319354 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d9631e7-a468-445e-880e-fc928e6425fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:46.447709 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8d9631e7-a468-445e-880e-fc928e6425fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:46.456437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8d9631e7-a468-445e-880e-fc928e6425fd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.158621 Jun 17 07:37:46.457064 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 197/399] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:46 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:47.300553 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ceed091d-48cf-4c78-9a19-2731047efc90 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:47.301086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ceed091d-48cf-4c78-9a19-2731047efc90 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:47.307561 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ceed091d-48cf-4c78-9a19-2731047efc90 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:47.313653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ceed091d-48cf-4c78-9a19-2731047efc90 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:47.313653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ceed091d-48cf-4c78-9a19-2731047efc90 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:47.313653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ceed091d-48cf-4c78-9a19-2731047efc90 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:47.374526 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ceed091d-48cf-4c78-9a19-2731047efc90 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:47.382399 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ceed091d-48cf-4c78-9a19-2731047efc90 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.085915 Jun 17 07:37:47.383215 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 203/400] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:47 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:47.474613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3fc42abf-057d-4645-9a09-9dd859adfba0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:47.475204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3fc42abf-057d-4645-9a09-9dd859adfba0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:47.482463 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3fc42abf-057d-4645-9a09-9dd859adfba0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:47.482925 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3fc42abf-057d-4645-9a09-9dd859adfba0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:47.483665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3fc42abf-057d-4645-9a09-9dd859adfba0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:47.484095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3fc42abf-057d-4645-9a09-9dd859adfba0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:47.622661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3fc42abf-057d-4645-9a09-9dd859adfba0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:47.630649 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3fc42abf-057d-4645-9a09-9dd859adfba0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.160029 Jun 17 07:37:47.631313 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 198/401] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:47 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:48.399578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-82830d6e-f782-4f65-abf3-bb015cf06297 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:48.400164 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-82830d6e-f782-4f65-abf3-bb015cf06297 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:48.402026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=4 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:48.407337 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-82830d6e-f782-4f65-abf3-bb015cf06297 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:48.407773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-82830d6e-f782-4f65-abf3-bb015cf06297 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:48.408885 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-82830d6e-f782-4f65-abf3-bb015cf06297 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:48.408980 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-82830d6e-f782-4f65-abf3-bb015cf06297 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:48.469253 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-82830d6e-f782-4f65-abf3-bb015cf06297 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:48.476809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-82830d6e-f782-4f65-abf3-bb015cf06297 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.081080 Jun 17 07:37:48.477405 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 204/402] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:48 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:48.649274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7ae5d0b6-fe1c-4587-af7e-fcd5d8677063 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:48.649956 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7ae5d0b6-fe1c-4587-af7e-fcd5d8677063 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:48.656436 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ae5d0b6-fe1c-4587-af7e-fcd5d8677063 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:48.656889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ae5d0b6-fe1c-4587-af7e-fcd5d8677063 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:48.657676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ae5d0b6-fe1c-4587-af7e-fcd5d8677063 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:48.658175 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ae5d0b6-fe1c-4587-af7e-fcd5d8677063 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:48.794970 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7ae5d0b6-fe1c-4587-af7e-fcd5d8677063 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:48.802503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7ae5d0b6-fe1c-4587-af7e-fcd5d8677063 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.157162 Jun 17 07:37:48.803154 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 199/403] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:48 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:49.492895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-61bb321f-4ea3-4d61-a223-b97814f7ccc6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:49.493529 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-61bb321f-4ea3-4d61-a223-b97814f7ccc6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:49.501297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-61bb321f-4ea3-4d61-a223-b97814f7ccc6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:49.501764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-61bb321f-4ea3-4d61-a223-b97814f7ccc6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:49.502536 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-61bb321f-4ea3-4d61-a223-b97814f7ccc6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:49.502968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-61bb321f-4ea3-4d61-a223-b97814f7ccc6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:49.563225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-61bb321f-4ea3-4d61-a223-b97814f7ccc6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:49.570596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-61bb321f-4ea3-4d61-a223-b97814f7ccc6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.081570 Jun 17 07:37:49.571166 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 205/404] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:49 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:49.819724 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4d54893f-0271-49e7-9616-22cf1f9e2634 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:49.820347 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4d54893f-0271-49e7-9616-22cf1f9e2634 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:49.826904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4d54893f-0271-49e7-9616-22cf1f9e2634 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:49.827345 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4d54893f-0271-49e7-9616-22cf1f9e2634 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:49.828092 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4d54893f-0271-49e7-9616-22cf1f9e2634 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:49.828540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4d54893f-0271-49e7-9616-22cf1f9e2634 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:49.843174 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:49.957148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4d54893f-0271-49e7-9616-22cf1f9e2634 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:49.964754 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4d54893f-0271-49e7-9616-22cf1f9e2634 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.148925 Jun 17 07:37:49.965350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 200/405] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:49 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:50.587231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-409d6c5f-36f5-429e-9af2-6fb3a8ac7cd0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:50.588079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-409d6c5f-36f5-429e-9af2-6fb3a8ac7cd0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:50.594581 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-409d6c5f-36f5-429e-9af2-6fb3a8ac7cd0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:50.595022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-409d6c5f-36f5-429e-9af2-6fb3a8ac7cd0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:50.595768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-409d6c5f-36f5-429e-9af2-6fb3a8ac7cd0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:50.596195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-409d6c5f-36f5-429e-9af2-6fb3a8ac7cd0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:50.655436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-409d6c5f-36f5-429e-9af2-6fb3a8ac7cd0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:50.663131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-409d6c5f-36f5-429e-9af2-6fb3a8ac7cd0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.079764 Jun 17 07:37:50.663691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 206/406] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:50 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:50.982818 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-09692e9c-7455-4d09-b22e-cb34b2e79e93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:50.983341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-09692e9c-7455-4d09-b22e-cb34b2e79e93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:50.989946 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-09692e9c-7455-4d09-b22e-cb34b2e79e93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:50.990386 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-09692e9c-7455-4d09-b22e-cb34b2e79e93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:50.991130 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-09692e9c-7455-4d09-b22e-cb34b2e79e93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:50.991558 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-09692e9c-7455-4d09-b22e-cb34b2e79e93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:51.121681 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-09692e9c-7455-4d09-b22e-cb34b2e79e93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:51.130513 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-09692e9c-7455-4d09-b22e-cb34b2e79e93 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.152185 Jun 17 07:37:51.131124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 201/407] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:50 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:51.679214 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-38ddeffd-0649-4e73-b657-c87768ad44f5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:51.679856 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-38ddeffd-0649-4e73-b657-c87768ad44f5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:51.690299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38ddeffd-0649-4e73-b657-c87768ad44f5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:51.690299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38ddeffd-0649-4e73-b657-c87768ad44f5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:51.690299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38ddeffd-0649-4e73-b657-c87768ad44f5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:51.690299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38ddeffd-0649-4e73-b657-c87768ad44f5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:51.750669 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-38ddeffd-0649-4e73-b657-c87768ad44f5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:51.758060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-38ddeffd-0649-4e73-b657-c87768ad44f5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.082662 Jun 17 07:37:51.758621 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 207/408] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:51 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:52.147963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-de73d2ec-bdb7-44fb-9cf6-b5a65b9c747d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:52.148567 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-de73d2ec-bdb7-44fb-9cf6-b5a65b9c747d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:52.154984 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de73d2ec-bdb7-44fb-9cf6-b5a65b9c747d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:52.155421 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de73d2ec-bdb7-44fb-9cf6-b5a65b9c747d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:52.156170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de73d2ec-bdb7-44fb-9cf6-b5a65b9c747d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:52.156624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-de73d2ec-bdb7-44fb-9cf6-b5a65b9c747d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:52.285459 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-de73d2ec-bdb7-44fb-9cf6-b5a65b9c747d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:52.292937 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-de73d2ec-bdb7-44fb-9cf6-b5a65b9c747d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.148993 Jun 17 07:37:52.293620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 202/409] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:52 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:52.774870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4e270b5c-7562-423e-8265-03a8bfe5f364 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:52.775491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4e270b5c-7562-423e-8265-03a8bfe5f364 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:52.782442 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4e270b5c-7562-423e-8265-03a8bfe5f364 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:52.782890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4e270b5c-7562-423e-8265-03a8bfe5f364 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:52.783646 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4e270b5c-7562-423e-8265-03a8bfe5f364 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:52.784083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4e270b5c-7562-423e-8265-03a8bfe5f364 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:52.843654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4e270b5c-7562-423e-8265-03a8bfe5f364 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:52.850958 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4e270b5c-7562-423e-8265-03a8bfe5f364 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.079925 Jun 17 07:37:52.851518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 208/410] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:52 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:53.310279 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ccecfaa7-93fd-47c9-89b5-b20ef3251c44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:53.311236 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ccecfaa7-93fd-47c9-89b5-b20ef3251c44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:53.317694 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ccecfaa7-93fd-47c9-89b5-b20ef3251c44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:53.318140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ccecfaa7-93fd-47c9-89b5-b20ef3251c44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:53.318897 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ccecfaa7-93fd-47c9-89b5-b20ef3251c44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:53.319332 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ccecfaa7-93fd-47c9-89b5-b20ef3251c44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:53.449507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ccecfaa7-93fd-47c9-89b5-b20ef3251c44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:53.457649 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ccecfaa7-93fd-47c9-89b5-b20ef3251c44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.151084 Jun 17 07:37:53.458219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 203/411] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:53 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:53.868172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-037d929c-289a-454a-831c-42dd385d8dec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:53.869044 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-037d929c-289a-454a-831c-42dd385d8dec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:53.875736 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-037d929c-289a-454a-831c-42dd385d8dec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:53.876188 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-037d929c-289a-454a-831c-42dd385d8dec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:53.876929 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-037d929c-289a-454a-831c-42dd385d8dec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:53.877375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-037d929c-289a-454a-831c-42dd385d8dec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:53.939083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-037d929c-289a-454a-831c-42dd385d8dec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:53.946513 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-037d929c-289a-454a-831c-42dd385d8dec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.082149 Jun 17 07:37:53.947071 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 209/412] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:53 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:54.476592 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a9146355-4acb-4db4-811c-ef02dd3cfc72 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:54.477283 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a9146355-4acb-4db4-811c-ef02dd3cfc72 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:54.486220 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a9146355-4acb-4db4-811c-ef02dd3cfc72 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:54.486673 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a9146355-4acb-4db4-811c-ef02dd3cfc72 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:54.487480 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a9146355-4acb-4db4-811c-ef02dd3cfc72 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:54.487921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a9146355-4acb-4db4-811c-ef02dd3cfc72 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:54.632102 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a9146355-4acb-4db4-811c-ef02dd3cfc72 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:54.639926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a9146355-4acb-4db4-811c-ef02dd3cfc72 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.167327 Jun 17 07:37:54.640499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 204/413] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:54 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:54.975156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-95164b9e-acb4-43e0-bcf9-7598fdda9e49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:54.975156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-95164b9e-acb4-43e0-bcf9-7598fdda9e49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:54.975156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-95164b9e-acb4-43e0-bcf9-7598fdda9e49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:54.975156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-95164b9e-acb4-43e0-bcf9-7598fdda9e49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:54.975985 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-95164b9e-acb4-43e0-bcf9-7598fdda9e49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:54.975985 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-95164b9e-acb4-43e0-bcf9-7598fdda9e49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:54.976422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:37:55.035720 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-95164b9e-acb4-43e0-bcf9-7598fdda9e49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:55.043013 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-95164b9e-acb4-43e0-bcf9-7598fdda9e49 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.083243 Jun 17 07:37:55.043595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 210/414] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:54 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:55.658618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b525dff6-3f85-4896-b959-b402281c8527 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:55.662069 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b525dff6-3f85-4896-b959-b402281c8527 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:55.669434 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b525dff6-3f85-4896-b959-b402281c8527 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:55.670048 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b525dff6-3f85-4896-b959-b402281c8527 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:55.670755 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b525dff6-3f85-4896-b959-b402281c8527 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:55.671273 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b525dff6-3f85-4896-b959-b402281c8527 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:55.804702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b525dff6-3f85-4896-b959-b402281c8527 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:55.812208 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b525dff6-3f85-4896-b959-b402281c8527 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.158350 Jun 17 07:37:55.812788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 205/415] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:55 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:56.060775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-755301bd-3186-48e7-87b2-a2a59a868ed4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:56.061408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-755301bd-3186-48e7-87b2-a2a59a868ed4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:56.068712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-755301bd-3186-48e7-87b2-a2a59a868ed4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:56.069440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-755301bd-3186-48e7-87b2-a2a59a868ed4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:56.069977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-755301bd-3186-48e7-87b2-a2a59a868ed4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:56.070422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-755301bd-3186-48e7-87b2-a2a59a868ed4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:56.145932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-755301bd-3186-48e7-87b2-a2a59a868ed4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:56.153344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-755301bd-3186-48e7-87b2-a2a59a868ed4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.096787 Jun 17 07:37:56.154116 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 211/416] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:56 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:56.828646 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-10d21d10-d5c8-4c38-b3e9-8d473a6df25c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:56.829808 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-10d21d10-d5c8-4c38-b3e9-8d473a6df25c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:56.837785 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10d21d10-d5c8-4c38-b3e9-8d473a6df25c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:56.837785 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10d21d10-d5c8-4c38-b3e9-8d473a6df25c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:56.838485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10d21d10-d5c8-4c38-b3e9-8d473a6df25c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:56.839034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10d21d10-d5c8-4c38-b3e9-8d473a6df25c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:57.170562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e852ebc9-0490-4c8a-be4d-119acbdcc8f8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:57.171195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e852ebc9-0490-4c8a-be4d-119acbdcc8f8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:57.178005 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e852ebc9-0490-4c8a-be4d-119acbdcc8f8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:57.178441 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e852ebc9-0490-4c8a-be4d-119acbdcc8f8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:57.179201 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e852ebc9-0490-4c8a-be4d-119acbdcc8f8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:57.179626 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e852ebc9-0490-4c8a-be4d-119acbdcc8f8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:57.249826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e852ebc9-0490-4c8a-be4d-119acbdcc8f8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:57.259219 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e852ebc9-0490-4c8a-be4d-119acbdcc8f8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.092478 Jun 17 07:37:57.260464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 212/417] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:57 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:37:57.286606 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-10d21d10-d5c8-4c38-b3e9-8d473a6df25c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:57.295950 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-10d21d10-d5c8-4c38-b3e9-8d473a6df25c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.470949 Jun 17 07:37:57.296794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 206/418] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:56 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:58.276151 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4498ca7d-6063-4e0f-9887-7a36b8475505 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:58.276824 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4498ca7d-6063-4e0f-9887-7a36b8475505 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:58.285507 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4498ca7d-6063-4e0f-9887-7a36b8475505 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:58.286273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4498ca7d-6063-4e0f-9887-7a36b8475505 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:58.287130 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4498ca7d-6063-4e0f-9887-7a36b8475505 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:58.288288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4498ca7d-6063-4e0f-9887-7a36b8475505 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:58.314325 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ad204527-2899-4701-88a3-afc3bad1e43e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:58.315791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ad204527-2899-4701-88a3-afc3bad1e43e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:58.325853 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ad204527-2899-4701-88a3-afc3bad1e43e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:58.326799 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ad204527-2899-4701-88a3-afc3bad1e43e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:58.334472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ad204527-2899-4701-88a3-afc3bad1e43e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:58.334472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ad204527-2899-4701-88a3-afc3bad1e43e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:58.376375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4498ca7d-6063-4e0f-9887-7a36b8475505 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:58.384836 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4498ca7d-6063-4e0f-9887-7a36b8475505 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1144 microversion: 2.1 time: 0.112432 Jun 17 07:37:58.386189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 213/419] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:58 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1144 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:58.605620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ad204527-2899-4701-88a3-afc3bad1e43e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:58.623226 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ad204527-2899-4701-88a3-afc3bad1e43e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.312878 Jun 17 07:37:58.625685 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 207/420] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:58 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:59.403152 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-afe86cea-6075-4361-8531-4d206912de6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:59.403757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-afe86cea-6075-4361-8531-4d206912de6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:59.410649 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-afe86cea-6075-4361-8531-4d206912de6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:59.411369 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-afe86cea-6075-4361-8531-4d206912de6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:59.412320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-afe86cea-6075-4361-8531-4d206912de6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:59.412959 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-afe86cea-6075-4361-8531-4d206912de6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:59.572340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-afe86cea-6075-4361-8531-4d206912de6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:59.582151 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-afe86cea-6075-4361-8531-4d206912de6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1192 microversion: 2.1 time: 0.182876 Jun 17 07:37:59.582945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 214/421] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:59 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1192 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:37:59.640378 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-57c43b8b-7049-48da-875e-de8ae53e092b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:37:59.641058 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-57c43b8b-7049-48da-875e-de8ae53e092b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:37:59.648184 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-57c43b8b-7049-48da-875e-de8ae53e092b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:59.648628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-57c43b8b-7049-48da-875e-de8ae53e092b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:59.649429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-57c43b8b-7049-48da-875e-de8ae53e092b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:37:59.649880 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-57c43b8b-7049-48da-875e-de8ae53e092b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:37:59.815000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-57c43b8b-7049-48da-875e-de8ae53e092b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:37:59.823982 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-57c43b8b-7049-48da-875e-de8ae53e092b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.187747 Jun 17 07:37:59.825170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 208/422] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:37:59 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:00.600706 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6d078262-df7b-4059-9e73-6f4ca9ab88d7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:00.601516 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6d078262-df7b-4059-9e73-6f4ca9ab88d7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:00.608233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6d078262-df7b-4059-9e73-6f4ca9ab88d7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:00.608760 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6d078262-df7b-4059-9e73-6f4ca9ab88d7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:00.609638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6d078262-df7b-4059-9e73-6f4ca9ab88d7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:00.610149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6d078262-df7b-4059-9e73-6f4ca9ab88d7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:00.742951 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6d078262-df7b-4059-9e73-6f4ca9ab88d7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:00.752743 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6d078262-df7b-4059-9e73-6f4ca9ab88d7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1200 microversion: 2.1 time: 0.155201 Jun 17 07:38:00.753724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 215/423] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:00 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1200 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:00.847778 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-eebc35ec-7897-46db-a27e-3e2d2b3ec85b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:00.848394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-eebc35ec-7897-46db-a27e-3e2d2b3ec85b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:00.859336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eebc35ec-7897-46db-a27e-3e2d2b3ec85b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:00.859963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eebc35ec-7897-46db-a27e-3e2d2b3ec85b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:00.861482 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eebc35ec-7897-46db-a27e-3e2d2b3ec85b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:00.862158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eebc35ec-7897-46db-a27e-3e2d2b3ec85b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:01.041642 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-eebc35ec-7897-46db-a27e-3e2d2b3ec85b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:01.051891 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-eebc35ec-7897-46db-a27e-3e2d2b3ec85b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.215572 Jun 17 07:38:01.063183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 209/424] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:00 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:01.222015 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-2b3119a0-d0ec-4419-ad18-483fd7e777a6 req-138b41fc-a10b-4850-9dc1-67f058b7caef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1866c92-f2f4-49e4-b391-ffca4b0ce35b", "name": "network-vif-plugged", "status": "completed", "tag": "1cbd5884-4ecf-4e5b-8a71-19880b70a371"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:01.232353 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-2b3119a0-d0ec-4419-ad18-483fd7e777a6 req-138b41fc-a10b-4850-9dc1-67f058b7caef service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:01.233027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-2b3119a0-d0ec-4419-ad18-483fd7e777a6 req-138b41fc-a10b-4850-9dc1-67f058b7caef service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:01.246983 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-2b3119a0-d0ec-4419-ad18-483fd7e777a6 req-138b41fc-a10b-4850-9dc1-67f058b7caef service nova] Creating event network-vif-plugged:1cbd5884-4ecf-4e5b-8a71-19880b70a371 for instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b on hv-cinder-79733 Jun 17 07:38:01.255580 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-2b3119a0-d0ec-4419-ad18-483fd7e777a6 req-138b41fc-a10b-4850-9dc1-67f058b7caef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037343 Jun 17 07:38:01.256916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 216/425] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:01.774114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-836e4f90-1444-401a-98a8-c31eb0961d99 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:01.774877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-836e4f90-1444-401a-98a8-c31eb0961d99 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:01.786293 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-836e4f90-1444-401a-98a8-c31eb0961d99 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:01.786777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-836e4f90-1444-401a-98a8-c31eb0961d99 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:01.787649 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-836e4f90-1444-401a-98a8-c31eb0961d99 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:01.788128 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-836e4f90-1444-401a-98a8-c31eb0961d99 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:02.059829 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-836e4f90-1444-401a-98a8-c31eb0961d99 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:02.072501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-836e4f90-1444-401a-98a8-c31eb0961d99 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1277 microversion: 2.1 time: 0.306234 Jun 17 07:38:02.073704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 210/426] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:01 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1277 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:02.078130 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ae895d71-bec9-4cae-9cce-64e5684adaef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:02.080093 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ae895d71-bec9-4cae-9cce-64e5684adaef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:02.087575 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae895d71-bec9-4cae-9cce-64e5684adaef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:02.088033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae895d71-bec9-4cae-9cce-64e5684adaef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:02.088803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae895d71-bec9-4cae-9cce-64e5684adaef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:02.089238 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae895d71-bec9-4cae-9cce-64e5684adaef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:02.244150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ae895d71-bec9-4cae-9cce-64e5684adaef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:02.252041 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ae895d71-bec9-4cae-9cce-64e5684adaef tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.184470 Jun 17 07:38:02.252651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 217/427] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:02 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:38:03.090736 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-60008ccb-be77-4357-96c7-277f0a369e30 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:03.091351 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-60008ccb-be77-4357-96c7-277f0a369e30 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:03.098858 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60008ccb-be77-4357-96c7-277f0a369e30 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:03.099323 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60008ccb-be77-4357-96c7-277f0a369e30 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:03.100081 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60008ccb-be77-4357-96c7-277f0a369e30 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:03.106977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-60008ccb-be77-4357-96c7-277f0a369e30 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:03.270357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-edd03523-e8ab-4c29-a0d9-2b70c89a63e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:03.270968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-edd03523-e8ab-4c29-a0d9-2b70c89a63e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:03.282228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-edd03523-e8ab-4c29-a0d9-2b70c89a63e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:03.285054 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-edd03523-e8ab-4c29-a0d9-2b70c89a63e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:03.286103 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-edd03523-e8ab-4c29-a0d9-2b70c89a63e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:03.289344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-edd03523-e8ab-4c29-a0d9-2b70c89a63e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:03.342368 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-60008ccb-be77-4357-96c7-277f0a369e30 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:03.358478 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-60008ccb-be77-4357-96c7-277f0a369e30 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1277 microversion: 2.1 time: 0.271077 Jun 17 07:38:03.359861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 211/428] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:03 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:03.577897 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-edd03523-e8ab-4c29-a0d9-2b70c89a63e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:03.586945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-edd03523-e8ab-4c29-a0d9-2b70c89a63e0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1371 microversion: 2.1 time: 0.321900 Jun 17 07:38:03.615160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 218/429] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:03 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:03.843801 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-ff592a03-aed1-4f99-bc5e-9a58363e2d32 req-87a12b02-15b1-433e-80ac-00945ec6739e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b922b8-4ba9-41d6-88a1-93b33e926c3d", "tag": "60118ee3-55e2-4a60-a28d-85637e355647"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:03.858491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-ff592a03-aed1-4f99-bc5e-9a58363e2d32 req-87a12b02-15b1-433e-80ac-00945ec6739e service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:03.858933 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-ff592a03-aed1-4f99-bc5e-9a58363e2d32 req-87a12b02-15b1-433e-80ac-00945ec6739e service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:03.906122 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-ff592a03-aed1-4f99-bc5e-9a58363e2d32 req-87a12b02-15b1-433e-80ac-00945ec6739e service nova] Creating event network-changed:60118ee3-55e2-4a60-a28d-85637e355647 for instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d on hv-cinder-79733 Jun 17 07:38:03.912282 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-ff592a03-aed1-4f99-bc5e-9a58363e2d32 req-87a12b02-15b1-433e-80ac-00945ec6739e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074126 Jun 17 07:38:03.912901 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 212/430] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:04.376792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-94c23624-e3e8-46e8-abfa-803d859d39b1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:04.381134 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-94c23624-e3e8-46e8-abfa-803d859d39b1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:04.385894 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-94c23624-e3e8-46e8-abfa-803d859d39b1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:04.386706 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-94c23624-e3e8-46e8-abfa-803d859d39b1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:04.387710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-94c23624-e3e8-46e8-abfa-803d859d39b1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:04.388377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-94c23624-e3e8-46e8-abfa-803d859d39b1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:04.572284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-94c23624-e3e8-46e8-abfa-803d859d39b1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:04.581264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-94c23624-e3e8-46e8-abfa-803d859d39b1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1277 microversion: 2.1 time: 0.208624 Jun 17 07:38:04.581882 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 219/431] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:04 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:04.604752 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1a393286-391d-469a-bb1e-87a40c9d455c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:04.606154 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1a393286-391d-469a-bb1e-87a40c9d455c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:04.614992 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a393286-391d-469a-bb1e-87a40c9d455c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:04.615628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a393286-391d-469a-bb1e-87a40c9d455c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:04.616861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a393286-391d-469a-bb1e-87a40c9d455c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:04.617516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a393286-391d-469a-bb1e-87a40c9d455c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:04.837688 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1a393286-391d-469a-bb1e-87a40c9d455c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:04.846900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1a393286-391d-469a-bb1e-87a40c9d455c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1565 microversion: 2.1 time: 0.246637 Jun 17 07:38:04.847828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 213/432] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:04 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1565 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:38:04.863914 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2a5eb47a-5b62-47c9-8587-3b3fe8a8e7f5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:04.864443 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2a5eb47a-5b62-47c9-8587-3b3fe8a8e7f5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:04.872603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a5eb47a-5b62-47c9-8587-3b3fe8a8e7f5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:04.873430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a5eb47a-5b62-47c9-8587-3b3fe8a8e7f5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:04.874629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a5eb47a-5b62-47c9-8587-3b3fe8a8e7f5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:04.875312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a5eb47a-5b62-47c9-8587-3b3fe8a8e7f5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:04.931144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ba425580-2afb-4643-afb1-24554e185fc8 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:04.932094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ba425580-2afb-4643-afb1-24554e185fc8 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:04.941385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ba425580-2afb-4643-afb1-24554e185fc8 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:04.942133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ba425580-2afb-4643-afb1-24554e185fc8 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:04.943137 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ba425580-2afb-4643-afb1-24554e185fc8 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:04.943763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ba425580-2afb-4643-afb1-24554e185fc8 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:05.084084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2a5eb47a-5b62-47c9-8587-3b3fe8a8e7f5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224353 Jun 17 07:38:05.086407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 220/433] 10.222.0.52 () {58 vars in 1274 bytes} [Fri Jun 17 07:38:04 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-interface => generated 285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:05.139958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-ba425580-2afb-4643-afb1-24554e185fc8 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lazy-loading 'services' on Instance uuid ead8bc69-fb51-4feb-a5aa-893812890c54 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:38:05.527696 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ba425580-2afb-4643-afb1-24554e185fc8 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54/os-volume_attachments/4b413880-8d1a-4d6b-9d07-f63315fdae89" status: 202 len: 0 microversion: 2.1 time: 0.601345 Jun 17 07:38:05.528453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 214/434] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:38:04 2022] DELETE /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54/os-volume_attachments/4b413880-8d1a-4d6b-9d07-f63315fdae89 => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:38:05.600826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3cfa80c3-acc6-4a73-8b90-6a210bb83bc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:05.601760 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3cfa80c3-acc6-4a73-8b90-6a210bb83bc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:05.633277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3cfa80c3-acc6-4a73-8b90-6a210bb83bc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:05.633277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3cfa80c3-acc6-4a73-8b90-6a210bb83bc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:05.642467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3cfa80c3-acc6-4a73-8b90-6a210bb83bc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:05.652282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3cfa80c3-acc6-4a73-8b90-6a210bb83bc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:06.113556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3cfa80c3-acc6-4a73-8b90-6a210bb83bc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:06.131460 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3cfa80c3-acc6-4a73-8b90-6a210bb83bc9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.536053 Jun 17 07:38:06.142075 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 221/435] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:05 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:06.912036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-18e8599e-fff1-4996-947b-7f0297654fed req-ee7f81a4-b12a-4da5-965b-e95844f3f2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1866c92-f2f4-49e4-b391-ffca4b0ce35b", "tag": "1cbd5884-4ecf-4e5b-8a71-19880b70a371"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:06.916469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:06.936881 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-18e8599e-fff1-4996-947b-7f0297654fed req-ee7f81a4-b12a-4da5-965b-e95844f3f2c4 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:06.938349 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-18e8599e-fff1-4996-947b-7f0297654fed req-ee7f81a4-b12a-4da5-965b-e95844f3f2c4 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:06.964069 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-18e8599e-fff1-4996-947b-7f0297654fed req-ee7f81a4-b12a-4da5-965b-e95844f3f2c4 service nova] Creating event network-changed:1cbd5884-4ecf-4e5b-8a71-19880b70a371 for instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b on hv-cinder-79733 Jun 17 07:38:06.969095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-18e8599e-fff1-4996-947b-7f0297654fed req-ee7f81a4-b12a-4da5-965b-e95844f3f2c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062363 Jun 17 07:38:06.970593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 215/436] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:07.158693 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-64caebd6-dd4f-4c10-a77d-64fabf2473c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:07.160477 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-64caebd6-dd4f-4c10-a77d-64fabf2473c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:07.167790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-64caebd6-dd4f-4c10-a77d-64fabf2473c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:07.171059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-64caebd6-dd4f-4c10-a77d-64fabf2473c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:07.171059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-64caebd6-dd4f-4c10-a77d-64fabf2473c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:07.171059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-64caebd6-dd4f-4c10-a77d-64fabf2473c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:07.423715 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-64caebd6-dd4f-4c10-a77d-64fabf2473c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:07.432931 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-64caebd6-dd4f-4c10-a77d-64fabf2473c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.277898 Jun 17 07:38:07.445023 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 222/437] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:07 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:07.792658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-258c7f86-f638-4a17-a83f-b3f01177a57d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:07.793247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-258c7f86-f638-4a17-a83f-b3f01177a57d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:07.811479 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-258c7f86-f638-4a17-a83f-b3f01177a57d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:07.811940 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-258c7f86-f638-4a17-a83f-b3f01177a57d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:07.812729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-258c7f86-f638-4a17-a83f-b3f01177a57d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:07.813709 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-258c7f86-f638-4a17-a83f-b3f01177a57d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:07.857963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-258c7f86-f638-4a17-a83f-b3f01177a57d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:38:07.898863 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:08.232733 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-258c7f86-f638-4a17-a83f-b3f01177a57d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 204 len: 0 microversion: 2.1 time: 0.444688 Jun 17 07:38:08.233408 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 216/438] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:38:07 2022] DELETE /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:38:08.241672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a7539697-cd02-4b81-8f8d-1ad23f131c35 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:08.251331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a7539697-cd02-4b81-8f8d-1ad23f131c35 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:08.251331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a7539697-cd02-4b81-8f8d-1ad23f131c35 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:08.251331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a7539697-cd02-4b81-8f8d-1ad23f131c35 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:08.251331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a7539697-cd02-4b81-8f8d-1ad23f131c35 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:08.251946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a7539697-cd02-4b81-8f8d-1ad23f131c35 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:08.452494 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0446f8a3-d155-4a3c-98cc-2bb8bc2ac7b6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:08.453187 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0446f8a3-d155-4a3c-98cc-2bb8bc2ac7b6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:08.466214 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0446f8a3-d155-4a3c-98cc-2bb8bc2ac7b6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:08.466668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0446f8a3-d155-4a3c-98cc-2bb8bc2ac7b6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:08.467471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0446f8a3-d155-4a3c-98cc-2bb8bc2ac7b6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:08.467908 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0446f8a3-d155-4a3c-98cc-2bb8bc2ac7b6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:08.477627 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a7539697-cd02-4b81-8f8d-1ad23f131c35 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:08.490297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a7539697-cd02-4b81-8f8d-1ad23f131c35 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1560 microversion: 2.1 time: 0.252297 Jun 17 07:38:08.494451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 223/439] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:08 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1560 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:08.681478 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0446f8a3-d155-4a3c-98cc-2bb8bc2ac7b6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:08.689855 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0446f8a3-d155-4a3c-98cc-2bb8bc2ac7b6 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.241488 Jun 17 07:38:08.700112 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 217/440] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:08 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:38:09.513222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3e417727-ab51-452f-90d0-ceb9016774b7 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:09.516161 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3e417727-ab51-452f-90d0-ceb9016774b7 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:09.520160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=62 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:09.524163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e417727-ab51-452f-90d0-ceb9016774b7 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:09.524478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e417727-ab51-452f-90d0-ceb9016774b7 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:09.525657 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e417727-ab51-452f-90d0-ceb9016774b7 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:09.526263 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e417727-ab51-452f-90d0-ceb9016774b7 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:09.674708 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3e417727-ab51-452f-90d0-ceb9016774b7 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:09.686355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3e417727-ab51-452f-90d0-ceb9016774b7 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1514 microversion: 2.1 time: 0.177656 Jun 17 07:38:09.686980 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 224/441] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:09 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:09.708144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-25e74c36-0090-4640-8974-41614d56682d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:09.708604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-25e74c36-0090-4640-8974-41614d56682d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:09.715594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-25e74c36-0090-4640-8974-41614d56682d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:09.721129 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-25e74c36-0090-4640-8974-41614d56682d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:09.721805 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-25e74c36-0090-4640-8974-41614d56682d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:09.721940 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-25e74c36-0090-4640-8974-41614d56682d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:10.018431 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-25e74c36-0090-4640-8974-41614d56682d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:10.018431 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-25e74c36-0090-4640-8974-41614d56682d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.309455 Jun 17 07:38:10.028215 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 218/442] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:09 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:10.709838 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1dc07a4a-aa02-4b88-93ca-93b43177ca5d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:10.711192 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1dc07a4a-aa02-4b88-93ca-93b43177ca5d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:10.721160 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1dc07a4a-aa02-4b88-93ca-93b43177ca5d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:10.722790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1dc07a4a-aa02-4b88-93ca-93b43177ca5d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:10.727600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1dc07a4a-aa02-4b88-93ca-93b43177ca5d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:10.727600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1dc07a4a-aa02-4b88-93ca-93b43177ca5d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:10.759622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d5357324-de7a-4c17-8285-2c4ee9c49e7c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Action: 'create', calling method: .version_select at 0x7fb06a738e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-664717037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElIHXeCrTacMRdVI3yBU/MdFdTNvs89zoOmYOW45cFMxEy4YWHFsmxTvnkoiI+TUkf6el87sZ1t6a1dHdsUbAwS9KNi/qc8Nzbt3N6E6wPSo5UFS13FuW4EKm50GAEgCA=="}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:10.795145 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-d5357324-de7a-4c17-8285-2c4ee9c49e7c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Getting quotas for project 5de5c6b438594f4eae8e7010ccf0ca65. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:38:10.802136 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-d5357324-de7a-4c17-8285-2c4ee9c49e7c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Getting quotas for user 5e9fc215b64a44c2b989e68c788c1534 and project 5de5c6b438594f4eae8e7010ccf0ca65. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:38:10.875513 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1dc07a4a-aa02-4b88-93ca-93b43177ca5d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:10.883467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1dc07a4a-aa02-4b88-93ca-93b43177ca5d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1514 microversion: 2.1 time: 0.182706 Jun 17 07:38:10.884036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 219/443] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:10 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:10.958012 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d5357324-de7a-4c17-8285-2c4ee9c49e7c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.456406 Jun 17 07:38:10.958557 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 225/444] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:38:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:11.035381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5f222d59-195a-4b4f-a90a-af97bfaec6a1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:11.035974 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5f222d59-195a-4b4f-a90a-af97bfaec6a1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:11.042000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5f222d59-195a-4b4f-a90a-af97bfaec6a1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:11.042461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5f222d59-195a-4b4f-a90a-af97bfaec6a1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:11.043192 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5f222d59-195a-4b4f-a90a-af97bfaec6a1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:11.043619 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5f222d59-195a-4b4f-a90a-af97bfaec6a1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:11.236480 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5f222d59-195a-4b4f-a90a-af97bfaec6a1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:11.244044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5f222d59-195a-4b4f-a90a-af97bfaec6a1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.212466 Jun 17 07:38:11.244631 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 220/445] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:11 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:11.902597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-76ebbf06-b4d8-46c2-ad24-55de364f9fef tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:11.903204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-76ebbf06-b4d8-46c2-ad24-55de364f9fef tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:11.910859 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-76ebbf06-b4d8-46c2-ad24-55de364f9fef tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:11.911300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-76ebbf06-b4d8-46c2-ad24-55de364f9fef tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:11.912063 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-76ebbf06-b4d8-46c2-ad24-55de364f9fef tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:11.912493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-76ebbf06-b4d8-46c2-ad24-55de364f9fef tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:12.041303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-76ebbf06-b4d8-46c2-ad24-55de364f9fef tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:12.054629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-76ebbf06-b4d8-46c2-ad24-55de364f9fef tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1472 microversion: 2.1 time: 0.156450 Jun 17 07:38:12.056091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 226/446] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:11 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:12.102064 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-42b8cd57-fa83-447a-bcd0-2f8c501591e8 req-9790716e-c205-440f-975f-db270b1e2c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead8bc69-fb51-4feb-a5aa-893812890c54", "name": "network-vif-deleted", "tag": "eb2093c5-84bc-4bb1-ba58-833eb8ee39a3"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:12.113124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-42b8cd57-fa83-447a-bcd0-2f8c501591e8 req-9790716e-c205-440f-975f-db270b1e2c7c service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:12.113601 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-42b8cd57-fa83-447a-bcd0-2f8c501591e8 req-9790716e-c205-440f-975f-db270b1e2c7c service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:12.129146 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-42b8cd57-fa83-447a-bcd0-2f8c501591e8 req-9790716e-c205-440f-975f-db270b1e2c7c service nova] Creating event network-vif-deleted:eb2093c5-84bc-4bb1-ba58-833eb8ee39a3 for instance ead8bc69-fb51-4feb-a5aa-893812890c54 on hv-cinder-79733 Jun 17 07:38:12.137516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-42b8cd57-fa83-447a-bcd0-2f8c501591e8 req-9790716e-c205-440f-975f-db270b1e2c7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037672 Jun 17 07:38:12.138679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 221/447] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:12.261943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7b942166-7856-4948-8b34-d27e3c22735b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:12.262546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7b942166-7856-4948-8b34-d27e3c22735b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:12.269698 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b942166-7856-4948-8b34-d27e3c22735b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:12.270175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b942166-7856-4948-8b34-d27e3c22735b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:12.270959 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b942166-7856-4948-8b34-d27e3c22735b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:12.271400 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b942166-7856-4948-8b34-d27e3c22735b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:12.466061 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7b942166-7856-4948-8b34-d27e3c22735b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:12.472402 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7b942166-7856-4948-8b34-d27e3c22735b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.214455 Jun 17 07:38:12.473067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 227/448] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:12 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:13.081821 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:13.082891 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:13.091288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:13.092273 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:13.093247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:13.097875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:13.138148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:13.138785 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:13.138969 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lazy-loading 'fault' on Instance uuid ead8bc69-fb51-4feb-a5aa-893812890c54 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:38:13.212675 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:13.227804 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-58a1a051-b26b-494c-93e5-d96d89af268e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 200 len: 1308 microversion: 2.1 time: 0.155060 Jun 17 07:38:13.239329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 222/449] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:13 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:13.490521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e870af12-744c-4c60-b6a5-102515e6fa7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:13.491313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e870af12-744c-4c60-b6a5-102515e6fa7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:13.501671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e870af12-744c-4c60-b6a5-102515e6fa7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:13.502428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e870af12-744c-4c60-b6a5-102515e6fa7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:13.503453 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e870af12-744c-4c60-b6a5-102515e6fa7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:13.503982 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e870af12-744c-4c60-b6a5-102515e6fa7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:13.702607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e870af12-744c-4c60-b6a5-102515e6fa7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:13.706758 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:13.711614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e870af12-744c-4c60-b6a5-102515e6fa7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.225835 Jun 17 07:38:13.712275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 228/450] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:13 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:14.246542 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:14.247148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: ead8bc69-fb51-4feb-a5aa-893812890c54] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:14.254288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:14.254737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:14.255560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:14.255938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:14.271880 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] HTTP exception thrown: Instance ead8bc69-fb51-4feb-a5aa-893812890c54 could not be found. Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Request method failure captured: Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 HTTP/1.1 Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC7GjbW3XitHtFxbNgYsKgInhXQ7dwUBuVDoykPCS5trF5Mru5_i_y0JhA3bq_gYP-tkphaDrkyZyYB75MyyvXLSdVIf5RZH5sWVKAVnz3a580uN82tyxqZmQf_cE6OhgiYKRT4L1trySf8GCE3aMkZemTde2ONDgah5pbDsBaIzrAU Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 9e64e39b616246e6974808d3d435e8ea Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1555455798 Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:38:14.273579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9e64e39b616246e6974808d3d435e8ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e64e39b616246e6974808d3d435e8ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9e64e39b616246e6974808d3d435e8ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e64e39b616246e6974808d3d435e8ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-VolumesSnapshotTestJSON-1555455798 Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 9e64e39b616246e6974808d3d435e8ea Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1555455798 Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-VolumesSnapshotTestJSON-1555455798-project Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: d4eeb8684c1e4c8da065e92fc5f04c01 Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-VolumesSnapshotTestJSON-1555455798-project Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance ead8bc69-fb51-4feb-a5aa-893812890c54 could not be found. Jun 17 07:38:14.275173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'ead8bc69-fb51-4feb-a5aa-893812890c54'} Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead8bc69-fb51-4feb-a5aa-893812890c54 could not be found. Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:38:14.276077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead8bc69-fb51-4feb-a5aa-893812890c54 could not be found. Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead8bc69-fb51-4feb-a5aa-893812890c54 could not be found. Jun 17 07:38:14.286087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:38:14.287507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Returning 404 to user: Instance ead8bc69-fb51-4feb-a5aa-893812890c54 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:38:14.287507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1d122911-f560-45e3-8341-c8030f3d4057 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54" status: 404 len: 111 microversion: 2.1 time: 0.037629 Jun 17 07:38:14.287507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 223/451] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:14 2022] GET /compute/v2.1/servers/ead8bc69-fb51-4feb-a5aa-893812890c54 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:38:14.728632 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7b081e1f-502b-442c-acfc-0a68ffcf7b8b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:14.729241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7b081e1f-502b-442c-acfc-0a68ffcf7b8b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:14.738404 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b081e1f-502b-442c-acfc-0a68ffcf7b8b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:14.738889 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b081e1f-502b-442c-acfc-0a68ffcf7b8b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:14.741496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b081e1f-502b-442c-acfc-0a68ffcf7b8b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:14.744489 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b081e1f-502b-442c-acfc-0a68ffcf7b8b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:14.889061 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7b081e1f-502b-442c-acfc-0a68ffcf7b8b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:14.897519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7b081e1f-502b-442c-acfc-0a68ffcf7b8b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.173365 Jun 17 07:38:14.898132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 229/452] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:14 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:15.915181 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e7c0679c-e0d6-498d-85d2-f32d61108b25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:15.915882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e7c0679c-e0d6-498d-85d2-f32d61108b25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:15.923354 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e7c0679c-e0d6-498d-85d2-f32d61108b25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:15.923867 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e7c0679c-e0d6-498d-85d2-f32d61108b25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:15.924678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e7c0679c-e0d6-498d-85d2-f32d61108b25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:15.925117 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e7c0679c-e0d6-498d-85d2-f32d61108b25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:16.060381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e7c0679c-e0d6-498d-85d2-f32d61108b25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:16.068799 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e7c0679c-e0d6-498d-85d2-f32d61108b25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.157512 Jun 17 07:38:16.069394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 224/453] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:15 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:17.085664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bd40bd62-f340-4b94-93f7-47e13b046690 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:17.086274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-bd40bd62-f340-4b94-93f7-47e13b046690 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:17.092766 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bd40bd62-f340-4b94-93f7-47e13b046690 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:17.093204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bd40bd62-f340-4b94-93f7-47e13b046690 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:17.093993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bd40bd62-f340-4b94-93f7-47e13b046690 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:17.094420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bd40bd62-f340-4b94-93f7-47e13b046690 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:17.225857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-bd40bd62-f340-4b94-93f7-47e13b046690 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:17.233226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-bd40bd62-f340-4b94-93f7-47e13b046690 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.151547 Jun 17 07:38:17.233814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 230/454] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:17 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:18.250270 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-10841799-468a-415a-9848-e74b5498f85a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:18.255313 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-10841799-468a-415a-9848-e74b5498f85a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:18.257787 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10841799-468a-415a-9848-e74b5498f85a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:18.258307 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10841799-468a-415a-9848-e74b5498f85a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:18.259073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10841799-468a-415a-9848-e74b5498f85a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:18.259513 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-10841799-468a-415a-9848-e74b5498f85a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:18.390773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-10841799-468a-415a-9848-e74b5498f85a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:18.399458 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-10841799-468a-415a-9848-e74b5498f85a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.153062 Jun 17 07:38:18.400034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 225/455] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:18 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:19.416335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-93b2c4e8-c466-45f8-a062-8cbcc9b04441 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:19.416972 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-93b2c4e8-c466-45f8-a062-8cbcc9b04441 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:19.423250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93b2c4e8-c466-45f8-a062-8cbcc9b04441 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:19.423681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93b2c4e8-c466-45f8-a062-8cbcc9b04441 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:19.424423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93b2c4e8-c466-45f8-a062-8cbcc9b04441 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:19.424850 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-93b2c4e8-c466-45f8-a062-8cbcc9b04441 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:19.786143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-93b2c4e8-c466-45f8-a062-8cbcc9b04441 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:19.795933 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-93b2c4e8-c466-45f8-a062-8cbcc9b04441 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.383466 Jun 17 07:38:19.796724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 231/456] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:19 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:20.813657 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9f28fea6-1e8f-42b7-a8c8-3d2663b198bb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:20.822578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9f28fea6-1e8f-42b7-a8c8-3d2663b198bb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:20.823016 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f28fea6-1e8f-42b7-a8c8-3d2663b198bb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:20.823110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f28fea6-1e8f-42b7-a8c8-3d2663b198bb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:20.823911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f28fea6-1e8f-42b7-a8c8-3d2663b198bb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:20.824387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f28fea6-1e8f-42b7-a8c8-3d2663b198bb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:20.965706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9f28fea6-1e8f-42b7-a8c8-3d2663b198bb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:20.973017 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9f28fea6-1e8f-42b7-a8c8-3d2663b198bb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.163518 Jun 17 07:38:20.973761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 226/457] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:20 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:21.719961 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=4 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:21.731881 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-509d650e-8dc0-4abe-a99d-8ceda83b577e req-f68a35f6-e871-48da-a51f-303597579ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b922b8-4ba9-41d6-88a1-93b33e926c3d", "name": "network-vif-plugged", "status": "completed", "tag": "60118ee3-55e2-4a60-a28d-85637e355647"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:21.740912 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-509d650e-8dc0-4abe-a99d-8ceda83b577e req-f68a35f6-e871-48da-a51f-303597579ab2 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:21.741637 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-509d650e-8dc0-4abe-a99d-8ceda83b577e req-f68a35f6-e871-48da-a51f-303597579ab2 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:21.752880 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-509d650e-8dc0-4abe-a99d-8ceda83b577e req-f68a35f6-e871-48da-a51f-303597579ab2 service nova] Creating event network-vif-plugged:60118ee3-55e2-4a60-a28d-85637e355647 for instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d on hv-cinder-79733 Jun 17 07:38:21.759086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-509d650e-8dc0-4abe-a99d-8ceda83b577e req-f68a35f6-e871-48da-a51f-303597579ab2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044296 Jun 17 07:38:21.759689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 232/458] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:38:21.990396 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ed2b897e-63b2-4d7a-a823-27c6958eef0a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:21.991058 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ed2b897e-63b2-4d7a-a823-27c6958eef0a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:21.999376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ed2b897e-63b2-4d7a-a823-27c6958eef0a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:21.999832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ed2b897e-63b2-4d7a-a823-27c6958eef0a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:22.000818 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ed2b897e-63b2-4d7a-a823-27c6958eef0a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:22.001607 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ed2b897e-63b2-4d7a-a823-27c6958eef0a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:22.146018 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ed2b897e-63b2-4d7a-a823-27c6958eef0a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:22.153582 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ed2b897e-63b2-4d7a-a823-27c6958eef0a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.168016 Jun 17 07:38:22.154213 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 227/459] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:21 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:23.172354 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2bcdba88-717e-43c2-819a-decb59770b5d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:23.173041 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2bcdba88-717e-43c2-819a-decb59770b5d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:23.179745 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2bcdba88-717e-43c2-819a-decb59770b5d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:23.180184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2bcdba88-717e-43c2-819a-decb59770b5d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:23.180926 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2bcdba88-717e-43c2-819a-decb59770b5d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:23.181514 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2bcdba88-717e-43c2-819a-decb59770b5d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:23.322496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2bcdba88-717e-43c2-819a-decb59770b5d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:23.330198 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2bcdba88-717e-43c2-819a-decb59770b5d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.163124 Jun 17 07:38:23.330759 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 233/460] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:23 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:24.347397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-75196ad9-6c81-4bd3-b9e0-aea89d51fb6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:24.348088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-75196ad9-6c81-4bd3-b9e0-aea89d51fb6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:24.354823 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-75196ad9-6c81-4bd3-b9e0-aea89d51fb6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:24.355269 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-75196ad9-6c81-4bd3-b9e0-aea89d51fb6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:24.356023 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-75196ad9-6c81-4bd3-b9e0-aea89d51fb6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:24.356452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-75196ad9-6c81-4bd3-b9e0-aea89d51fb6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:24.494904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-75196ad9-6c81-4bd3-b9e0-aea89d51fb6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:24.502329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-75196ad9-6c81-4bd3-b9e0-aea89d51fb6f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.158808 Jun 17 07:38:24.502900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 228/461] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:24 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:25.519303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ba567b8f-16e7-41bb-b83c-8b11addd3b67 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:25.519900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ba567b8f-16e7-41bb-b83c-8b11addd3b67 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:25.527003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba567b8f-16e7-41bb-b83c-8b11addd3b67 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:25.527450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba567b8f-16e7-41bb-b83c-8b11addd3b67 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:25.528210 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba567b8f-16e7-41bb-b83c-8b11addd3b67 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:25.528637 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba567b8f-16e7-41bb-b83c-8b11addd3b67 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:25.661780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ba567b8f-16e7-41bb-b83c-8b11addd3b67 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:25.670388 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ba567b8f-16e7-41bb-b83c-8b11addd3b67 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.154808 Jun 17 07:38:25.670963 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 234/462] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:25 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:26.687948 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c2482ae6-6fb9-4181-99b4-0920b5c6f3fd tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:26.688572 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c2482ae6-6fb9-4181-99b4-0920b5c6f3fd tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:26.695438 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2482ae6-6fb9-4181-99b4-0920b5c6f3fd tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:26.695878 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2482ae6-6fb9-4181-99b4-0920b5c6f3fd tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:26.696645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2482ae6-6fb9-4181-99b4-0920b5c6f3fd tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:26.697081 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2482ae6-6fb9-4181-99b4-0920b5c6f3fd tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:26.841629 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c2482ae6-6fb9-4181-99b4-0920b5c6f3fd tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:26.851009 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c2482ae6-6fb9-4181-99b4-0920b5c6f3fd tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.166569 Jun 17 07:38:26.851598 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 229/463] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:26 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:27.868041 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7c1cc7a7-39c4-4034-a463-816001fac0e4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:27.869279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7c1cc7a7-39c4-4034-a463-816001fac0e4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:27.875599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c1cc7a7-39c4-4034-a463-816001fac0e4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:27.876043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c1cc7a7-39c4-4034-a463-816001fac0e4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:27.876795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c1cc7a7-39c4-4034-a463-816001fac0e4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:27.877226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c1cc7a7-39c4-4034-a463-816001fac0e4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:28.006707 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7c1cc7a7-39c4-4034-a463-816001fac0e4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:28.014845 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7c1cc7a7-39c4-4034-a463-816001fac0e4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.150898 Jun 17 07:38:28.015404 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 235/464] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:27 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:29.032964 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7ac622aa-b65f-438d-a988-1d41634cb739 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:29.033523 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7ac622aa-b65f-438d-a988-1d41634cb739 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:29.040302 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ac622aa-b65f-438d-a988-1d41634cb739 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:29.041091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ac622aa-b65f-438d-a988-1d41634cb739 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:29.041909 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ac622aa-b65f-438d-a988-1d41634cb739 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:29.042461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7ac622aa-b65f-438d-a988-1d41634cb739 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:29.177104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7ac622aa-b65f-438d-a988-1d41634cb739 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:29.185663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7ac622aa-b65f-438d-a988-1d41634cb739 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1265 microversion: 2.1 time: 0.157359 Jun 17 07:38:29.186247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 230/465] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:29 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:29.771312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-472524695", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "networks": [{"uuid": "6bd29aca-d311-4cc6-952e-92134474670f"}]}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:29.833712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] validate_networks() for [('6bd29aca-d311-4cc6-952e-92134474670f', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:38:30.204002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-24bd1164-c2e3-42ae-b23a-f96c309f5e1c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:30.204610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-24bd1164-c2e3-42ae-b23a-f96c309f5e1c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:30.211109 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24bd1164-c2e3-42ae-b23a-f96c309f5e1c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:30.211561 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24bd1164-c2e3-42ae-b23a-f96c309f5e1c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:30.212997 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24bd1164-c2e3-42ae-b23a-f96c309f5e1c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:30.213730 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24bd1164-c2e3-42ae-b23a-f96c309f5e1c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:30.333293 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:38:30.334070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:38:30.335237 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:38:30.336642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:38:30.337693 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:38:30.353178 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:30.353974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:30.354844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:30.355391 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:30.374000 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Getting quotas for project 9e64e39b616246e6974808d3d435e8ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:38:30.389814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Getting quotas for user d4eeb8684c1e4c8da065e92fc5f04c01 and project 9e64e39b616246e6974808d3d435e8ea. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:38:30.389958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-24bd1164-c2e3-42ae-b23a-f96c309f5e1c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:30.389958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-24bd1164-c2e3-42ae-b23a-f96c309f5e1c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1451 microversion: 2.1 time: 0.188998 Jun 17 07:38:30.389958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 231/466] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:30 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1451 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:38:30.390248 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:38:30.392034 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:38:30.407049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-093ecc3e-4571-4599-9bfb-c4a92de96ed0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:30.407702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-093ecc3e-4571-4599-9bfb-c4a92de96ed0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:30.413817 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-093ecc3e-4571-4599-9bfb-c4a92de96ed0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:30.414254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-093ecc3e-4571-4599-9bfb-c4a92de96ed0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:30.415171 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-093ecc3e-4571-4599-9bfb-c4a92de96ed0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:30.416025 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-093ecc3e-4571-4599-9bfb-c4a92de96ed0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:30.503187 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2face02b-0986-4f95-93af-9f26d90e412b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736006 Jun 17 07:38:30.509546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 236/467] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:38:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:38:30.514641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f598325e-9922-464e-bbe4-081185003e05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:30.527076 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f598325e-9922-464e-bbe4-081185003e05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:30.570105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-093ecc3e-4571-4599-9bfb-c4a92de96ed0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:30.580100 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-093ecc3e-4571-4599-9bfb-c4a92de96ed0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1451 microversion: 2.1 time: 0.176868 Jun 17 07:38:30.580956 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 232/468] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:30 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:30.582187 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f598325e-9922-464e-bbe4-081185003e05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:30.591755 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f598325e-9922-464e-bbe4-081185003e05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1218 microversion: 2.1 time: 0.080787 Jun 17 07:38:30.592771 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 237/469] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:30 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:31.610405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-200465e1-96d2-4cdf-8767-2f66bddc9689 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:31.611014 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-200465e1-96d2-4cdf-8767-2f66bddc9689 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:31.618664 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-200465e1-96d2-4cdf-8767-2f66bddc9689 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:31.619279 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-200465e1-96d2-4cdf-8767-2f66bddc9689 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:31.620156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-200465e1-96d2-4cdf-8767-2f66bddc9689 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:31.620701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-200465e1-96d2-4cdf-8767-2f66bddc9689 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:31.718810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-200465e1-96d2-4cdf-8767-2f66bddc9689 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:31.722024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:31.728505 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-200465e1-96d2-4cdf-8767-2f66bddc9689 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1222 microversion: 2.1 time: 0.121839 Jun 17 07:38:31.729666 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 233/470] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:31 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:32.746556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-731bc8fc-272c-4147-8dcc-dc51b4818b7d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:32.747313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-731bc8fc-272c-4147-8dcc-dc51b4818b7d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:32.753987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-731bc8fc-272c-4147-8dcc-dc51b4818b7d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:32.754396 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-731bc8fc-272c-4147-8dcc-dc51b4818b7d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:32.755327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-731bc8fc-272c-4147-8dcc-dc51b4818b7d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:32.755667 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-731bc8fc-272c-4147-8dcc-dc51b4818b7d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:32.823145 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-731bc8fc-272c-4147-8dcc-dc51b4818b7d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:32.831252 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-731bc8fc-272c-4147-8dcc-dc51b4818b7d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1270 microversion: 2.1 time: 0.088934 Jun 17 07:38:32.831845 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 238/471] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:32 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:33.183527 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-b572b51d-000b-48c3-beee-9b69375e960d req-90ae320c-da92-4917-9831-8ddc2b540a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b922b8-4ba9-41d6-88a1-93b33e926c3d", "tag": "60118ee3-55e2-4a60-a28d-85637e355647"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:33.198935 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-b572b51d-000b-48c3-beee-9b69375e960d req-90ae320c-da92-4917-9831-8ddc2b540a6c service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:33.199695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-b572b51d-000b-48c3-beee-9b69375e960d req-90ae320c-da92-4917-9831-8ddc2b540a6c service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:33.214577 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-b572b51d-000b-48c3-beee-9b69375e960d req-90ae320c-da92-4917-9831-8ddc2b540a6c service nova] Creating event network-changed:60118ee3-55e2-4a60-a28d-85637e355647 for instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d on hv-cinder-79733 Jun 17 07:38:33.220661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-b572b51d-000b-48c3-beee-9b69375e960d req-90ae320c-da92-4917-9831-8ddc2b540a6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042051 Jun 17 07:38:33.221317 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 234/472] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:33.850852 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0d8d7f93-3567-469d-a162-4438655c808b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:33.852208 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0d8d7f93-3567-469d-a162-4438655c808b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:33.862243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d8d7f93-3567-469d-a162-4438655c808b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:33.863330 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d8d7f93-3567-469d-a162-4438655c808b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:33.864408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d8d7f93-3567-469d-a162-4438655c808b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:33.865171 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d8d7f93-3567-469d-a162-4438655c808b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:33.941106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0d8d7f93-3567-469d-a162-4438655c808b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:33.949300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0d8d7f93-3567-469d-a162-4438655c808b tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1276 microversion: 2.1 time: 0.102866 Jun 17 07:38:33.959250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 239/473] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:33 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:34.968673 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e8906bab-9140-44b8-bb16-7a9095bc529f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:34.969416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e8906bab-9140-44b8-bb16-7a9095bc529f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:34.976063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8906bab-9140-44b8-bb16-7a9095bc529f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:34.976503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8906bab-9140-44b8-bb16-7a9095bc529f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:34.977625 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8906bab-9140-44b8-bb16-7a9095bc529f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:34.977889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8906bab-9140-44b8-bb16-7a9095bc529f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:35.112695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e8906bab-9140-44b8-bb16-7a9095bc529f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:35.120961 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e8906bab-9140-44b8-bb16-7a9095bc529f tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.157138 Jun 17 07:38:35.121585 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 235/474] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:34 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:35.135739 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-a0b11ab7-24f2-4842-8145-cda85d01faa3 req-97f2087b-63de-4f39-bba2-c15f81f1d995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "556fcf69-50ad-45e3-b4dd-891ed7f57b74", "tag": "c6c017b2-7ca6-4926-a228-a31d34e70e19"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:35.144878 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-a0b11ab7-24f2-4842-8145-cda85d01faa3 req-97f2087b-63de-4f39-bba2-c15f81f1d995 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:35.145239 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-a0b11ab7-24f2-4842-8145-cda85d01faa3 req-97f2087b-63de-4f39-bba2-c15f81f1d995 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:35.157609 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-a0b11ab7-24f2-4842-8145-cda85d01faa3 req-97f2087b-63de-4f39-bba2-c15f81f1d995 service nova] Creating event network-changed:c6c017b2-7ca6-4926-a228-a31d34e70e19 for instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 on hv-cinder-79733 Jun 17 07:38:35.162478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-a0b11ab7-24f2-4842-8145-cda85d01faa3 req-97f2087b-63de-4f39-bba2-c15f81f1d995 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039124 Jun 17 07:38:35.163300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 240/475] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:36.139097 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f61e7a77-8d8e-438d-8a05-79c77b3428fa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:36.139704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f61e7a77-8d8e-438d-8a05-79c77b3428fa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:36.146099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f61e7a77-8d8e-438d-8a05-79c77b3428fa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:36.146546 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f61e7a77-8d8e-438d-8a05-79c77b3428fa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:36.147299 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f61e7a77-8d8e-438d-8a05-79c77b3428fa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:36.147736 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f61e7a77-8d8e-438d-8a05-79c77b3428fa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:36.279391 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f61e7a77-8d8e-438d-8a05-79c77b3428fa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:36.286854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f61e7a77-8d8e-438d-8a05-79c77b3428fa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.152572 Jun 17 07:38:36.287422 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 236/476] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:36 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:37.304394 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4d2562ab-0681-413a-8cbc-555ccd48d0a3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:37.305083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4d2562ab-0681-413a-8cbc-555ccd48d0a3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:37.312243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d2562ab-0681-413a-8cbc-555ccd48d0a3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:37.312683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d2562ab-0681-413a-8cbc-555ccd48d0a3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:37.313475 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d2562ab-0681-413a-8cbc-555ccd48d0a3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:37.313908 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d2562ab-0681-413a-8cbc-555ccd48d0a3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:37.449287 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4d2562ab-0681-413a-8cbc-555ccd48d0a3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:37.456977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4d2562ab-0681-413a-8cbc-555ccd48d0a3 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.156737 Jun 17 07:38:37.457642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 241/477] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:37 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:38.474485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-62b9d88f-bf15-4879-a590-9f7c16d3d19c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:38.475219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-62b9d88f-bf15-4879-a590-9f7c16d3d19c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:38.477545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:38.483482 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-62b9d88f-bf15-4879-a590-9f7c16d3d19c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:38.483932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-62b9d88f-bf15-4879-a590-9f7c16d3d19c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:38.484690 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-62b9d88f-bf15-4879-a590-9f7c16d3d19c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:38.485125 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-62b9d88f-bf15-4879-a590-9f7c16d3d19c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:38.618811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-62b9d88f-bf15-4879-a590-9f7c16d3d19c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:38.626854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-62b9d88f-bf15-4879-a590-9f7c16d3d19c tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.156250 Jun 17 07:38:38.627417 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 237/478] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:38 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:39.643490 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b3e5244e-bf5f-4b25-a261-eebd7d6e1700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:39.644091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b3e5244e-bf5f-4b25-a261-eebd7d6e1700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:39.650622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b3e5244e-bf5f-4b25-a261-eebd7d6e1700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:39.651690 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b3e5244e-bf5f-4b25-a261-eebd7d6e1700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:39.652691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b3e5244e-bf5f-4b25-a261-eebd7d6e1700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:39.653119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b3e5244e-bf5f-4b25-a261-eebd7d6e1700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:39.780332 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b3e5244e-bf5f-4b25-a261-eebd7d6e1700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:39.787639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b3e5244e-bf5f-4b25-a261-eebd7d6e1700 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.147963 Jun 17 07:38:39.788196 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 242/479] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:39 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:40.805193 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c8f1e27f-bee1-4b05-8955-48d794217485 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:40.805836 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c8f1e27f-bee1-4b05-8955-48d794217485 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:40.813560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c8f1e27f-bee1-4b05-8955-48d794217485 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:40.814005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c8f1e27f-bee1-4b05-8955-48d794217485 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:40.814755 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c8f1e27f-bee1-4b05-8955-48d794217485 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:40.815186 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c8f1e27f-bee1-4b05-8955-48d794217485 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:40.946257 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c8f1e27f-bee1-4b05-8955-48d794217485 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:40.954141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c8f1e27f-bee1-4b05-8955-48d794217485 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.152813 Jun 17 07:38:40.954741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 238/480] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:40 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:41.970843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8c69fc10-f66e-4c9a-af2e-5016970961dc tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:41.971458 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8c69fc10-f66e-4c9a-af2e-5016970961dc tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:41.973385 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:41.974081 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=8 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:41.975170 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:41.979938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c69fc10-f66e-4c9a-af2e-5016970961dc tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:41.980331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c69fc10-f66e-4c9a-af2e-5016970961dc tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:41.981089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c69fc10-f66e-4c9a-af2e-5016970961dc tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:41.981684 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c69fc10-f66e-4c9a-af2e-5016970961dc tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:42.112217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8c69fc10-f66e-4c9a-af2e-5016970961dc tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:42.119954 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8c69fc10-f66e-4c9a-af2e-5016970961dc tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.152933 Jun 17 07:38:42.120516 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 243/481] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:41 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:43.137905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-302de056-eff0-43b9-b2db-e15b3082caaa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:43.139016 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-302de056-eff0-43b9-b2db-e15b3082caaa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:43.145462 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-302de056-eff0-43b9-b2db-e15b3082caaa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:43.145905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-302de056-eff0-43b9-b2db-e15b3082caaa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:43.146657 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-302de056-eff0-43b9-b2db-e15b3082caaa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:43.147343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-302de056-eff0-43b9-b2db-e15b3082caaa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:43.278444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-302de056-eff0-43b9-b2db-e15b3082caaa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:43.286594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-302de056-eff0-43b9-b2db-e15b3082caaa tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.152602 Jun 17 07:38:43.287157 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 239/482] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:43 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:44.303942 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8ca45e85-9985-4639-8c5b-1e8702702806 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:44.304479 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8ca45e85-9985-4639-8c5b-1e8702702806 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:44.311443 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8ca45e85-9985-4639-8c5b-1e8702702806 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:44.311874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8ca45e85-9985-4639-8c5b-1e8702702806 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:44.312656 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8ca45e85-9985-4639-8c5b-1e8702702806 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:44.313091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8ca45e85-9985-4639-8c5b-1e8702702806 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:44.447427 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8ca45e85-9985-4639-8c5b-1e8702702806 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:44.454887 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8ca45e85-9985-4639-8c5b-1e8702702806 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.155280 Jun 17 07:38:44.455460 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 244/483] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:44 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:45.472474 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-116945b8-5207-4a25-9414-5f416abb5ace tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:45.473106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-116945b8-5207-4a25-9414-5f416abb5ace tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:45.479905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-116945b8-5207-4a25-9414-5f416abb5ace tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:45.480354 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-116945b8-5207-4a25-9414-5f416abb5ace tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:45.481108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-116945b8-5207-4a25-9414-5f416abb5ace tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:45.481570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-116945b8-5207-4a25-9414-5f416abb5ace tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:45.613245 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-116945b8-5207-4a25-9414-5f416abb5ace tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:45.621145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-116945b8-5207-4a25-9414-5f416abb5ace tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.152533 Jun 17 07:38:45.621746 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 240/484] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:45 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:46.639158 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4d173d0e-f3f1-40bd-b62e-9063de1decd4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:46.639769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4d173d0e-f3f1-40bd-b62e-9063de1decd4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:46.646231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d173d0e-f3f1-40bd-b62e-9063de1decd4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:46.646681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d173d0e-f3f1-40bd-b62e-9063de1decd4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:46.647434 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d173d0e-f3f1-40bd-b62e-9063de1decd4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:46.647992 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d173d0e-f3f1-40bd-b62e-9063de1decd4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:46.650507 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=79 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:38:46.794506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4d173d0e-f3f1-40bd-b62e-9063de1decd4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:46.802479 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4d173d0e-f3f1-40bd-b62e-9063de1decd4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.167149 Jun 17 07:38:46.803049 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 245/485] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:46 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:47.819645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1a58e5d7-548b-4362-9d0c-778330e93a97 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:47.820294 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1a58e5d7-548b-4362-9d0c-778330e93a97 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:47.827499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a58e5d7-548b-4362-9d0c-778330e93a97 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:47.827945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a58e5d7-548b-4362-9d0c-778330e93a97 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:47.828763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a58e5d7-548b-4362-9d0c-778330e93a97 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:47.829204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a58e5d7-548b-4362-9d0c-778330e93a97 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:47.965568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1a58e5d7-548b-4362-9d0c-778330e93a97 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:47.973494 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1a58e5d7-548b-4362-9d0c-778330e93a97 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.157706 Jun 17 07:38:47.974104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 241/486] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:47 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:48.634844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-36346516-e596-4302-96f0-d6da39d8a4d0 req-c3d72b19-2a0d-4fcf-bf0f-1b5e28b2ac1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556fcf69-50ad-45e3-b4dd-891ed7f57b74", "name": "network-vif-plugged", "status": "completed", "tag": "c6c017b2-7ca6-4926-a228-a31d34e70e19"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:48.643787 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-36346516-e596-4302-96f0-d6da39d8a4d0 req-c3d72b19-2a0d-4fcf-bf0f-1b5e28b2ac1b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:48.644225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-36346516-e596-4302-96f0-d6da39d8a4d0 req-c3d72b19-2a0d-4fcf-bf0f-1b5e28b2ac1b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:48.655712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-36346516-e596-4302-96f0-d6da39d8a4d0 req-c3d72b19-2a0d-4fcf-bf0f-1b5e28b2ac1b service nova] Creating event network-vif-plugged:c6c017b2-7ca6-4926-a228-a31d34e70e19 for instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 on hv-cinder-79733 Jun 17 07:38:48.660757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-36346516-e596-4302-96f0-d6da39d8a4d0 req-c3d72b19-2a0d-4fcf-bf0f-1b5e28b2ac1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029576 Jun 17 07:38:48.661376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 246/487] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:48.990711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-825a6dc9-c5c8-4663-993f-b767353e905e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:48.991336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-825a6dc9-c5c8-4663-993f-b767353e905e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:48.998271 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-825a6dc9-c5c8-4663-993f-b767353e905e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:48.999418 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-825a6dc9-c5c8-4663-993f-b767353e905e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:49.000242 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-825a6dc9-c5c8-4663-993f-b767353e905e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:49.000709 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-825a6dc9-c5c8-4663-993f-b767353e905e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:49.132354 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-825a6dc9-c5c8-4663-993f-b767353e905e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:49.140444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-825a6dc9-c5c8-4663-993f-b767353e905e tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.153587 Jun 17 07:38:49.141052 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 242/488] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:48 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:38:50.158793 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-141908be-df3a-49ea-9449-cb1880f3e3b4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:50.159475 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-141908be-df3a-49ea-9449-cb1880f3e3b4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:50.165651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-141908be-df3a-49ea-9449-cb1880f3e3b4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:50.166088 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-141908be-df3a-49ea-9449-cb1880f3e3b4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:50.166837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-141908be-df3a-49ea-9449-cb1880f3e3b4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:50.167260 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-141908be-df3a-49ea-9449-cb1880f3e3b4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:50.299156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-141908be-df3a-49ea-9449-cb1880f3e3b4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:50.306877 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-141908be-df3a-49ea-9449-cb1880f3e3b4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.152569 Jun 17 07:38:50.307649 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 247/489] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:50 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:51.324169 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3a0468ca-b113-4138-8c08-cd744450e0e4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:51.325061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3a0468ca-b113-4138-8c08-cd744450e0e4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:51.332334 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a0468ca-b113-4138-8c08-cd744450e0e4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:51.332874 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a0468ca-b113-4138-8c08-cd744450e0e4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:51.334361 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a0468ca-b113-4138-8c08-cd744450e0e4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:51.334882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a0468ca-b113-4138-8c08-cd744450e0e4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:51.471654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3a0468ca-b113-4138-8c08-cd744450e0e4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:51.482055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3a0468ca-b113-4138-8c08-cd744450e0e4 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1318 microversion: 2.1 time: 0.161633 Jun 17 07:38:51.482689 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 243/490] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:51 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:52.500295 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-09209b61-4454-49bd-956e-ac8887fb6169 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:52.500928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-09209b61-4454-49bd-956e-ac8887fb6169 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:52.507395 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-09209b61-4454-49bd-956e-ac8887fb6169 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:52.507833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-09209b61-4454-49bd-956e-ac8887fb6169 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:52.508579 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-09209b61-4454-49bd-956e-ac8887fb6169 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:52.509051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-09209b61-4454-49bd-956e-ac8887fb6169 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:52.643167 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-09209b61-4454-49bd-956e-ac8887fb6169 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:52.650660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-09209b61-4454-49bd-956e-ac8887fb6169 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1507 microversion: 2.1 time: 0.154722 Jun 17 07:38:52.651220 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 248/491] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:52 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:52.672186 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b744a290-1df7-4629-91fe-c6a1caba861a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "537693bd-3cbf-47ae-9344-71a62f66f57f", "device": "/dev/sdb"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:52.673805 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b744a290-1df7-4629-91fe-c6a1caba861a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:52.680385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b744a290-1df7-4629-91fe-c6a1caba861a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:52.680915 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b744a290-1df7-4629-91fe-c6a1caba861a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:52.681772 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b744a290-1df7-4629-91fe-c6a1caba861a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:52.682265 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b744a290-1df7-4629-91fe-c6a1caba861a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:53.446776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b744a290-1df7-4629-91fe-c6a1caba861a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "POST /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.780478 Jun 17 07:38:53.447416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 244/492] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:38:52 2022] POST /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:38:55.656776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1812633294", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-664717037", "security_groups": [{"name": "tempest-secgroup-smoke-1226521321"}], "networks": [{"uuid": "5e751fff-3ff7-47f5-931a-6134b42e7d55"}], "block_device_mapping_v2": [{"uuid": "e035db9c-faf7-436d-9f27-f04a9004d304", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:38:55.779831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] validate_networks() for [('5e751fff-3ff7-47f5-931a-6134b42e7d55', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:38:56.158382 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:38:56.158938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:38:56.159494 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:38:56.160040 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:38:56.160561 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:38:56.172174 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:56.172765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:56.173699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:56.174266 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:56.195760 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Getting quotas for project 5de5c6b438594f4eae8e7010ccf0ca65. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:38:56.201773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Getting quotas for user 5e9fc215b64a44c2b989e68c788c1534 and project 5de5c6b438594f4eae8e7010ccf0ca65. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:38:56.261431 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:38:56.263562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e035db9c-faf7-436d-9f27-f04a9004d304',volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:38:56.751919 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cefa26b1-3937-4c78-af53-2667843cbbf3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.098823 Jun 17 07:38:56.752956 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 249/493] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:38:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:38:56.764155 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3c403649-859a-4b24-874a-780ebd1664c3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:56.764844 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3c403649-859a-4b24-874a-780ebd1664c3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:56.825955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3c403649-859a-4b24-874a-780ebd1664c3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:56.833211 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3c403649-859a-4b24-874a-780ebd1664c3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1088 microversion: 2.1 time: 0.073816 Jun 17 07:38:56.833762 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 245/494] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:56 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:38:57.851271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-540119a1-952e-48c3-803f-7621efa2a802 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:57.851807 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-540119a1-952e-48c3-803f-7621efa2a802 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:57.912741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-540119a1-952e-48c3-803f-7621efa2a802 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:57.920640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-540119a1-952e-48c3-803f-7621efa2a802 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1088 microversion: 2.1 time: 0.073924 Jun 17 07:38:57.921276 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 250/495] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:57 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:38:58.938751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5d4cf42c-c28d-483e-a6c7-764a736221aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:38:58.939304 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5d4cf42c-c28d-483e-a6c7-764a736221aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:38:58.946717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d4cf42c-c28d-483e-a6c7-764a736221aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:58.947160 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d4cf42c-c28d-483e-a6c7-764a736221aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:58.947919 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d4cf42c-c28d-483e-a6c7-764a736221aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:38:58.948383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d4cf42c-c28d-483e-a6c7-764a736221aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:38:59.016584 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5d4cf42c-c28d-483e-a6c7-764a736221aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:38:59.024365 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5d4cf42c-c28d-483e-a6c7-764a736221aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1186 microversion: 2.1 time: 0.089523 Jun 17 07:38:59.024949 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 246/496] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:38:58 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:00.045646 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c7dae19f-6429-47d9-bedf-6c1db5e4aa03 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:00.046301 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c7dae19f-6429-47d9-bedf-6c1db5e4aa03 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:00.054548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c7dae19f-6429-47d9-bedf-6c1db5e4aa03 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:00.054975 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c7dae19f-6429-47d9-bedf-6c1db5e4aa03 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:00.055744 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c7dae19f-6429-47d9-bedf-6c1db5e4aa03 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:00.056180 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c7dae19f-6429-47d9-bedf-6c1db5e4aa03 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:00.149149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c7dae19f-6429-47d9-bedf-6c1db5e4aa03 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:00.157398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c7dae19f-6429-47d9-bedf-6c1db5e4aa03 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1204 microversion: 2.1 time: 0.115636 Jun 17 07:39:00.158183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 251/497] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:00 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1204 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:39:01.177611 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9acc2367-d776-4cd1-9d38-2f2f80b5869a tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:01.178190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9acc2367-d776-4cd1-9d38-2f2f80b5869a tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:01.188812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9acc2367-d776-4cd1-9d38-2f2f80b5869a tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:01.188812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9acc2367-d776-4cd1-9d38-2f2f80b5869a tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:01.188812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9acc2367-d776-4cd1-9d38-2f2f80b5869a tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:01.188812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9acc2367-d776-4cd1-9d38-2f2f80b5869a tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:01.357356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9acc2367-d776-4cd1-9d38-2f2f80b5869a tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:01.366887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9acc2367-d776-4cd1-9d38-2f2f80b5869a tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1272 microversion: 2.1 time: 0.193671 Jun 17 07:39:01.367564 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 247/498] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:01 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:01.877524 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-77885a5f-80a7-4a82-857a-1b62984cb54f req-d3ab5a91-2cdc-4a4c-ac85-119e261997fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a5406c-f3f3-41ee-b763-cfcabfa91915", "tag": "745661a1-a356-4257-97ca-68167916d2cd"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:39:01.891400 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-77885a5f-80a7-4a82-857a-1b62984cb54f req-d3ab5a91-2cdc-4a4c-ac85-119e261997fc service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:01.892164 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-77885a5f-80a7-4a82-857a-1b62984cb54f req-d3ab5a91-2cdc-4a4c-ac85-119e261997fc service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:01.909815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-77885a5f-80a7-4a82-857a-1b62984cb54f req-d3ab5a91-2cdc-4a4c-ac85-119e261997fc service nova] Creating event network-changed:745661a1-a356-4257-97ca-68167916d2cd for instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 on hv-cinder-79733 Jun 17 07:39:01.917847 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-77885a5f-80a7-4a82-857a-1b62984cb54f req-d3ab5a91-2cdc-4a4c-ac85-119e261997fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052598 Jun 17 07:39:01.919069 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 252/499] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:39:02.387036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2cd9ed4a-354a-45b4-b3f2-5ba19980053e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:02.387751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2cd9ed4a-354a-45b4-b3f2-5ba19980053e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:02.395237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2cd9ed4a-354a-45b4-b3f2-5ba19980053e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:02.395684 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2cd9ed4a-354a-45b4-b3f2-5ba19980053e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:02.396444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2cd9ed4a-354a-45b4-b3f2-5ba19980053e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:02.396883 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2cd9ed4a-354a-45b4-b3f2-5ba19980053e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:02.536899 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2cd9ed4a-354a-45b4-b3f2-5ba19980053e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:02.544408 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2cd9ed4a-354a-45b4-b3f2-5ba19980053e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1272 microversion: 2.1 time: 0.161936 Jun 17 07:39:02.544987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 248/500] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:02 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:03.562924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fab8a64d-cdd6-4c0d-8b1a-65c732bb1dfd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:03.563630 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fab8a64d-cdd6-4c0d-8b1a-65c732bb1dfd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:03.570340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fab8a64d-cdd6-4c0d-8b1a-65c732bb1dfd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:03.570785 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fab8a64d-cdd6-4c0d-8b1a-65c732bb1dfd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:03.571683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fab8a64d-cdd6-4c0d-8b1a-65c732bb1dfd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:03.572153 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fab8a64d-cdd6-4c0d-8b1a-65c732bb1dfd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:03.722052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fab8a64d-cdd6-4c0d-8b1a-65c732bb1dfd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:03.729552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fab8a64d-cdd6-4c0d-8b1a-65c732bb1dfd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1272 microversion: 2.1 time: 0.171618 Jun 17 07:39:03.730133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 253/501] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:03 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:04.746817 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0f1e410a-5d92-4cd1-b203-b5e6cf939f4b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:04.747413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0f1e410a-5d92-4cd1-b203-b5e6cf939f4b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:04.754311 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f1e410a-5d92-4cd1-b203-b5e6cf939f4b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:04.754781 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f1e410a-5d92-4cd1-b203-b5e6cf939f4b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:04.755526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f1e410a-5d92-4cd1-b203-b5e6cf939f4b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:04.755992 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f1e410a-5d92-4cd1-b203-b5e6cf939f4b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:04.894315 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0f1e410a-5d92-4cd1-b203-b5e6cf939f4b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:04.901723 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0f1e410a-5d92-4cd1-b203-b5e6cf939f4b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.158763 Jun 17 07:39:04.902276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 249/502] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:04 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:05.919454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-763ccf4f-b1b0-42d4-b2a6-e29be3e91d47 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:05.919976 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-763ccf4f-b1b0-42d4-b2a6-e29be3e91d47 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:05.927012 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-763ccf4f-b1b0-42d4-b2a6-e29be3e91d47 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:05.927528 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-763ccf4f-b1b0-42d4-b2a6-e29be3e91d47 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:05.928225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-763ccf4f-b1b0-42d4-b2a6-e29be3e91d47 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:05.928660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-763ccf4f-b1b0-42d4-b2a6-e29be3e91d47 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:06.085626 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-763ccf4f-b1b0-42d4-b2a6-e29be3e91d47 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:06.094243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-763ccf4f-b1b0-42d4-b2a6-e29be3e91d47 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.178618 Jun 17 07:39:06.094861 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 254/503] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:05 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:07.111708 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-88ff7f42-992f-4783-af88-9c450253a0a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:07.112371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-88ff7f42-992f-4783-af88-9c450253a0a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:07.114844 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:07.119891 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-88ff7f42-992f-4783-af88-9c450253a0a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:07.120330 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-88ff7f42-992f-4783-af88-9c450253a0a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:07.121077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-88ff7f42-992f-4783-af88-9c450253a0a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:07.121545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-88ff7f42-992f-4783-af88-9c450253a0a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:07.126159 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:07.254655 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-88ff7f42-992f-4783-af88-9c450253a0a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:07.262216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-88ff7f42-992f-4783-af88-9c450253a0a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.154932 Jun 17 07:39:07.263016 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 250/504] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:07 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:08.279557 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-006712b3-9e7d-4774-96b3-e8c1e8354f48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:08.280082 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-006712b3-9e7d-4774-96b3-e8c1e8354f48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:08.282049 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:08.283174 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=8 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:08.287967 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-006712b3-9e7d-4774-96b3-e8c1e8354f48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:08.288445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-006712b3-9e7d-4774-96b3-e8c1e8354f48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:08.289193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-006712b3-9e7d-4774-96b3-e8c1e8354f48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:08.289654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-006712b3-9e7d-4774-96b3-e8c1e8354f48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:08.423811 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-006712b3-9e7d-4774-96b3-e8c1e8354f48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:08.431279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-006712b3-9e7d-4774-96b3-e8c1e8354f48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.155853 Jun 17 07:39:08.431846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 255/505] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:08 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:09.448912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-29c568d5-7489-421b-8f7c-13af5f3794c7 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:09.449536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-29c568d5-7489-421b-8f7c-13af5f3794c7 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:09.451807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=30 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:09.456753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-29c568d5-7489-421b-8f7c-13af5f3794c7 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:09.457196 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-29c568d5-7489-421b-8f7c-13af5f3794c7 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:09.458076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-29c568d5-7489-421b-8f7c-13af5f3794c7 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:09.458573 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-29c568d5-7489-421b-8f7c-13af5f3794c7 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:09.592073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-29c568d5-7489-421b-8f7c-13af5f3794c7 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:09.600030 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-29c568d5-7489-421b-8f7c-13af5f3794c7 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.155048 Jun 17 07:39:09.600600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 251/506] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:09 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:10.619796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-20b4d687-008e-4733-8301-7fd48ff4b5b9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:10.627670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-20b4d687-008e-4733-8301-7fd48ff4b5b9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:10.628332 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-20b4d687-008e-4733-8301-7fd48ff4b5b9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:10.628776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-20b4d687-008e-4733-8301-7fd48ff4b5b9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:10.629552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-20b4d687-008e-4733-8301-7fd48ff4b5b9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:10.629983 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-20b4d687-008e-4733-8301-7fd48ff4b5b9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:10.762635 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-20b4d687-008e-4733-8301-7fd48ff4b5b9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:10.770189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-20b4d687-008e-4733-8301-7fd48ff4b5b9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.154555 Jun 17 07:39:10.770763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 256/507] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:10 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:11.787097 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bafc7b23-28bb-4963-82e3-37aeab9886b8 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:11.787706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bafc7b23-28bb-4963-82e3-37aeab9886b8 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:11.794441 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bafc7b23-28bb-4963-82e3-37aeab9886b8 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:11.796871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bafc7b23-28bb-4963-82e3-37aeab9886b8 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:11.796871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bafc7b23-28bb-4963-82e3-37aeab9886b8 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:11.796871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bafc7b23-28bb-4963-82e3-37aeab9886b8 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:11.930276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-bafc7b23-28bb-4963-82e3-37aeab9886b8 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:11.938217 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bafc7b23-28bb-4963-82e3-37aeab9886b8 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.155073 Jun 17 07:39:11.938785 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 252/508] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:11 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:12.955748 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0c55d0f8-2147-4951-a3cc-e5d60b2c90fb tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:12.956352 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0c55d0f8-2147-4951-a3cc-e5d60b2c90fb tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:12.962562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c55d0f8-2147-4951-a3cc-e5d60b2c90fb tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:12.963009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c55d0f8-2147-4951-a3cc-e5d60b2c90fb tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:12.963762 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c55d0f8-2147-4951-a3cc-e5d60b2c90fb tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:12.964193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c55d0f8-2147-4951-a3cc-e5d60b2c90fb tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:13.093457 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0c55d0f8-2147-4951-a3cc-e5d60b2c90fb tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:13.101917 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0c55d0f8-2147-4951-a3cc-e5d60b2c90fb tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.150548 Jun 17 07:39:13.102500 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 257/509] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:12 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:14.119150 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c94b2477-11e4-4a11-a0df-105481829a8b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:14.119792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c94b2477-11e4-4a11-a0df-105481829a8b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:14.126901 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c94b2477-11e4-4a11-a0df-105481829a8b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:14.127355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c94b2477-11e4-4a11-a0df-105481829a8b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:14.128116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c94b2477-11e4-4a11-a0df-105481829a8b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:14.128558 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c94b2477-11e4-4a11-a0df-105481829a8b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:14.268613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c94b2477-11e4-4a11-a0df-105481829a8b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:14.276206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c94b2477-11e4-4a11-a0df-105481829a8b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.161213 Jun 17 07:39:14.276763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 253/510] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:14 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:15.293470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1435952d-2bfe-4701-abfa-0fb151542a89 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:15.294079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1435952d-2bfe-4701-abfa-0fb151542a89 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:15.296418 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:15.301476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1435952d-2bfe-4701-abfa-0fb151542a89 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:15.301877 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1435952d-2bfe-4701-abfa-0fb151542a89 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:15.302623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1435952d-2bfe-4701-abfa-0fb151542a89 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:15.303051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1435952d-2bfe-4701-abfa-0fb151542a89 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:15.439435 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1435952d-2bfe-4701-abfa-0fb151542a89 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:15.447149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1435952d-2bfe-4701-abfa-0fb151542a89 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.157386 Jun 17 07:39:15.447748 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 258/511] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:15 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:16.428412 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-27991618-2118-4944-8c5d-01bccdd4ec22 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:39:16.429422 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-27991618-2118-4944-8c5d-01bccdd4ec22 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:16.435960 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-27991618-2118-4944-8c5d-01bccdd4ec22 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:16.436413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-27991618-2118-4944-8c5d-01bccdd4ec22 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:16.437182 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-27991618-2118-4944-8c5d-01bccdd4ec22 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:16.437646 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-27991618-2118-4944-8c5d-01bccdd4ec22 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:16.466257 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fc0a46f4-e275-46d0-8caf-635b1ba6b1af tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:16.466856 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fc0a46f4-e275-46d0-8caf-635b1ba6b1af tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:16.474560 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc0a46f4-e275-46d0-8caf-635b1ba6b1af tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:16.474995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc0a46f4-e275-46d0-8caf-635b1ba6b1af tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:16.475744 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc0a46f4-e275-46d0-8caf-635b1ba6b1af tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:16.476170 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc0a46f4-e275-46d0-8caf-635b1ba6b1af tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:16.607070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fc0a46f4-e275-46d0-8caf-635b1ba6b1af tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:16.614622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fc0a46f4-e275-46d0-8caf-635b1ba6b1af tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.153237 Jun 17 07:39:16.615949 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 259/512] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:16 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:39:17.631922 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0843209c-a756-47c2-b773-eb5af06ac67b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:17.632553 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0843209c-a756-47c2-b773-eb5af06ac67b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:17.639303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0843209c-a756-47c2-b773-eb5af06ac67b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:17.643060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0843209c-a756-47c2-b773-eb5af06ac67b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:17.643060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0843209c-a756-47c2-b773-eb5af06ac67b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:17.643060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0843209c-a756-47c2-b773-eb5af06ac67b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:17.644146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=72 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:17.784734 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0843209c-a756-47c2-b773-eb5af06ac67b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:17.792150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0843209c-a756-47c2-b773-eb5af06ac67b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.164149 Jun 17 07:39:17.792719 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 260/513] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:17 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:39:18.809313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-699629b9-9213-49ca-b042-a62370205096 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:18.809937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-699629b9-9213-49ca-b042-a62370205096 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:18.816454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-699629b9-9213-49ca-b042-a62370205096 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:18.816890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-699629b9-9213-49ca-b042-a62370205096 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:18.817742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-699629b9-9213-49ca-b042-a62370205096 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:18.818173 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-699629b9-9213-49ca-b042-a62370205096 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:18.949798 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-699629b9-9213-49ca-b042-a62370205096 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:18.957959 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-699629b9-9213-49ca-b042-a62370205096 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.152379 Jun 17 07:39:18.958525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 261/514] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:18 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:39:19.974540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e5225a44-d7de-42b0-88fe-eb0c3433a1a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:19.975157 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e5225a44-d7de-42b0-88fe-eb0c3433a1a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:19.981545 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e5225a44-d7de-42b0-88fe-eb0c3433a1a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:19.981990 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e5225a44-d7de-42b0-88fe-eb0c3433a1a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:19.982738 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e5225a44-d7de-42b0-88fe-eb0c3433a1a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:19.983195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e5225a44-d7de-42b0-88fe-eb0c3433a1a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:20.116312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e5225a44-d7de-42b0-88fe-eb0c3433a1a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:20.123641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e5225a44-d7de-42b0-88fe-eb0c3433a1a0 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.153030 Jun 17 07:39:20.124277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 262/515] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:19 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:39:20.234028 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-27991618-2118-4944-8c5d-01bccdd4ec22 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/action" status: 200 len: 28637 microversion: 2.20 time: 3.809196 Jun 17 07:39:20.234605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 254/516] 10.222.0.52 () {62 vars in 1318 bytes} [Fri Jun 17 07:39:16 2022] POST /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/action => generated 28637 bytes in 3811 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:39:21.141138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8c6552c7-f053-490b-ae78-3e95a70b21a9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:21.141798 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8c6552c7-f053-490b-ae78-3e95a70b21a9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:21.148526 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c6552c7-f053-490b-ae78-3e95a70b21a9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:21.148976 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c6552c7-f053-490b-ae78-3e95a70b21a9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:21.149770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c6552c7-f053-490b-ae78-3e95a70b21a9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:21.150203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c6552c7-f053-490b-ae78-3e95a70b21a9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:21.281101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8c6552c7-f053-490b-ae78-3e95a70b21a9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:21.288670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8c6552c7-f053-490b-ae78-3e95a70b21a9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.151361 Jun 17 07:39:21.289240 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 263/517] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:21 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:22.306257 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e2c9ffb9-35e2-4a32-9b4e-f53481bfea20 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:22.306862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e2c9ffb9-35e2-4a32-9b4e-f53481bfea20 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:22.314970 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e2c9ffb9-35e2-4a32-9b4e-f53481bfea20 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:22.315419 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e2c9ffb9-35e2-4a32-9b4e-f53481bfea20 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:22.316181 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e2c9ffb9-35e2-4a32-9b4e-f53481bfea20 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:22.316622 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e2c9ffb9-35e2-4a32-9b4e-f53481bfea20 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:22.448770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e2c9ffb9-35e2-4a32-9b4e-f53481bfea20 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:22.457258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e2c9ffb9-35e2-4a32-9b4e-f53481bfea20 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.155366 Jun 17 07:39:22.457857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 255/518] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:22 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:23.474306 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7af55b28-fd57-4ef1-a12c-ef4dbac5090d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:23.474913 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7af55b28-fd57-4ef1-a12c-ef4dbac5090d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:23.481547 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7af55b28-fd57-4ef1-a12c-ef4dbac5090d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:23.481994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7af55b28-fd57-4ef1-a12c-ef4dbac5090d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:23.482744 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7af55b28-fd57-4ef1-a12c-ef4dbac5090d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:23.483177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7af55b28-fd57-4ef1-a12c-ef4dbac5090d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:23.615438 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7af55b28-fd57-4ef1-a12c-ef4dbac5090d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:23.623297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7af55b28-fd57-4ef1-a12c-ef4dbac5090d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.153051 Jun 17 07:39:23.623868 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 264/519] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:23 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:24.640823 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-159c3a98-40ea-4242-b592-2745396f8872 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:24.641477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-159c3a98-40ea-4242-b592-2745396f8872 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:24.648023 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-159c3a98-40ea-4242-b592-2745396f8872 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:24.648465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-159c3a98-40ea-4242-b592-2745396f8872 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:24.649284 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-159c3a98-40ea-4242-b592-2745396f8872 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:24.649771 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-159c3a98-40ea-4242-b592-2745396f8872 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:24.900878 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-159c3a98-40ea-4242-b592-2745396f8872 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:24.908877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-159c3a98-40ea-4242-b592-2745396f8872 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.272055 Jun 17 07:39:24.910181 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 256/520] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:24 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:39:24.951312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-64cdfe8e-29ba-43b5-982e-03e9f54254f1 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:24.951857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-64cdfe8e-29ba-43b5-982e-03e9f54254f1 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:24.958757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-64cdfe8e-29ba-43b5-982e-03e9f54254f1 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:24.959200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-64cdfe8e-29ba-43b5-982e-03e9f54254f1 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:24.959955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-64cdfe8e-29ba-43b5-982e-03e9f54254f1 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:24.960380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-64cdfe8e-29ba-43b5-982e-03e9f54254f1 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:25.091156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-64cdfe8e-29ba-43b5-982e-03e9f54254f1 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lazy-loading 'services' on Instance uuid 556fcf69-50ad-45e3-b4dd-891ed7f57b74 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:39:25.400724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-64cdfe8e-29ba-43b5-982e-03e9f54254f1 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74/os-volume_attachments/537693bd-3cbf-47ae-9344-71a62f66f57f" status: 202 len: 0 microversion: 2.1 time: 0.453114 Jun 17 07:39:25.401317 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 265/521] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:39:24 2022] DELETE /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74/os-volume_attachments/537693bd-3cbf-47ae-9344-71a62f66f57f => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:39:25.927265 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3c44aac8-23d2-40c4-b9c5-bd0696f38add tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:25.927887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3c44aac8-23d2-40c4-b9c5-bd0696f38add tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:25.935264 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c44aac8-23d2-40c4-b9c5-bd0696f38add tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:25.935717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c44aac8-23d2-40c4-b9c5-bd0696f38add tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:25.936536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c44aac8-23d2-40c4-b9c5-bd0696f38add tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:25.937033 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c44aac8-23d2-40c4-b9c5-bd0696f38add tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:26.078032 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3c44aac8-23d2-40c4-b9c5-bd0696f38add tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:26.086287 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3c44aac8-23d2-40c4-b9c5-bd0696f38add tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.163735 Jun 17 07:39:26.086849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 257/522] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:25 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:27.104335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-97c2282f-8f00-40e5-847c-b2a1c4c3f281 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:27.105024 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-97c2282f-8f00-40e5-847c-b2a1c4c3f281 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:27.111333 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97c2282f-8f00-40e5-847c-b2a1c4c3f281 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:27.111768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97c2282f-8f00-40e5-847c-b2a1c4c3f281 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:27.112521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97c2282f-8f00-40e5-847c-b2a1c4c3f281 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:27.112954 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97c2282f-8f00-40e5-847c-b2a1c4c3f281 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:27.264745 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-97c2282f-8f00-40e5-847c-b2a1c4c3f281 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:27.272210 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-97c2282f-8f00-40e5-847c-b2a1c4c3f281 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.172585 Jun 17 07:39:27.272770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 266/523] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:27 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:27.644801 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-7039cecf-a089-49aa-bd89-dd5eb897195b req-cfa88e1f-786f-4cf3-8b68-18169527116b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a5406c-f3f3-41ee-b763-cfcabfa91915", "name": "network-vif-plugged", "status": "completed", "tag": "745661a1-a356-4257-97ca-68167916d2cd"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:39:27.654110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-7039cecf-a089-49aa-bd89-dd5eb897195b req-cfa88e1f-786f-4cf3-8b68-18169527116b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:27.654559 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-7039cecf-a089-49aa-bd89-dd5eb897195b req-cfa88e1f-786f-4cf3-8b68-18169527116b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:27.665595 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-7039cecf-a089-49aa-bd89-dd5eb897195b req-cfa88e1f-786f-4cf3-8b68-18169527116b service nova] Creating event network-vif-plugged:745661a1-a356-4257-97ca-68167916d2cd for instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 on hv-cinder-79733 Jun 17 07:39:27.671435 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-7039cecf-a089-49aa-bd89-dd5eb897195b req-cfa88e1f-786f-4cf3-8b68-18169527116b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032409 Jun 17 07:39:27.672042 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 258/524] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:39:28.289446 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-683dbc73-1179-43e2-8f87-a82165c1dd2f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:28.290054 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-683dbc73-1179-43e2-8f87-a82165c1dd2f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:28.297409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-683dbc73-1179-43e2-8f87-a82165c1dd2f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:28.297994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-683dbc73-1179-43e2-8f87-a82165c1dd2f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:28.298843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-683dbc73-1179-43e2-8f87-a82165c1dd2f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:28.300140 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-683dbc73-1179-43e2-8f87-a82165c1dd2f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:28.448147 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-683dbc73-1179-43e2-8f87-a82165c1dd2f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:28.455660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-683dbc73-1179-43e2-8f87-a82165c1dd2f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.170130 Jun 17 07:39:28.456580 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 267/525] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:28 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:28.621853 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9ded60ac-6067-4035-9f4d-85c74f135e2a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:28.622436 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9ded60ac-6067-4035-9f4d-85c74f135e2a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:28.629573 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9ded60ac-6067-4035-9f4d-85c74f135e2a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:28.630036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9ded60ac-6067-4035-9f4d-85c74f135e2a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:28.630888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9ded60ac-6067-4035-9f4d-85c74f135e2a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:28.631323 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9ded60ac-6067-4035-9f4d-85c74f135e2a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:28.656300 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9ded60ac-6067-4035-9f4d-85c74f135e2a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:39:28.958756 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9ded60ac-6067-4035-9f4d-85c74f135e2a tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "DELETE /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 204 len: 0 microversion: 2.1 time: 0.340909 Jun 17 07:39:28.959346 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 259/526] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:39:28 2022] DELETE /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:39:28.967872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2e4b69f3-4be3-4f62-9fdf-17e86af67cee tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:28.968515 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2e4b69f3-4be3-4f62-9fdf-17e86af67cee tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:28.974963 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2e4b69f3-4be3-4f62-9fdf-17e86af67cee tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:28.975407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2e4b69f3-4be3-4f62-9fdf-17e86af67cee tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:28.976160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2e4b69f3-4be3-4f62-9fdf-17e86af67cee tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:28.976592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2e4b69f3-4be3-4f62-9fdf-17e86af67cee tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:29.105039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2e4b69f3-4be3-4f62-9fdf-17e86af67cee tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:29.112608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2e4b69f3-4be3-4f62-9fdf-17e86af67cee tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1513 microversion: 2.1 time: 0.148802 Jun 17 07:39:29.113177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 268/527] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:28 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:29.479255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ce2b94d1-9d30-4c4a-adac-9cda882f689e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:29.479951 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ce2b94d1-9d30-4c4a-adac-9cda882f689e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:29.487549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ce2b94d1-9d30-4c4a-adac-9cda882f689e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:29.488640 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ce2b94d1-9d30-4c4a-adac-9cda882f689e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:29.489463 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ce2b94d1-9d30-4c4a-adac-9cda882f689e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:29.489900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ce2b94d1-9d30-4c4a-adac-9cda882f689e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:29.622798 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ce2b94d1-9d30-4c4a-adac-9cda882f689e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:29.630965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ce2b94d1-9d30-4c4a-adac-9cda882f689e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.155973 Jun 17 07:39:29.631534 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 260/528] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:29 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:30.130175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ae165182-ecf9-40ce-afef-d7648075af05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:30.130772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ae165182-ecf9-40ce-afef-d7648075af05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:30.137713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae165182-ecf9-40ce-afef-d7648075af05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:30.138156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae165182-ecf9-40ce-afef-d7648075af05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:30.138895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae165182-ecf9-40ce-afef-d7648075af05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:30.139320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae165182-ecf9-40ce-afef-d7648075af05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:30.271051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ae165182-ecf9-40ce-afef-d7648075af05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:30.278628 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ae165182-ecf9-40ce-afef-d7648075af05 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1513 microversion: 2.1 time: 0.152378 Jun 17 07:39:30.279199 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 269/529] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:30 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:30.648346 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-82009d3a-2fa1-4de5-8b51-e6cb4d2a3dc5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:30.648987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-82009d3a-2fa1-4de5-8b51-e6cb4d2a3dc5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:30.655556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-82009d3a-2fa1-4de5-8b51-e6cb4d2a3dc5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:30.656000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-82009d3a-2fa1-4de5-8b51-e6cb4d2a3dc5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:30.656767 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-82009d3a-2fa1-4de5-8b51-e6cb4d2a3dc5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:30.657202 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-82009d3a-2fa1-4de5-8b51-e6cb4d2a3dc5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:30.792255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-82009d3a-2fa1-4de5-8b51-e6cb4d2a3dc5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:30.800387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-82009d3a-2fa1-4de5-8b51-e6cb4d2a3dc5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1260 microversion: 2.1 time: 0.155278 Jun 17 07:39:30.800962 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 261/530] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:30 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:31.295517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b194538d-4cd2-4317-b044-30a5a83ebc9d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:31.296161 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b194538d-4cd2-4317-b044-30a5a83ebc9d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:31.303037 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b194538d-4cd2-4317-b044-30a5a83ebc9d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:31.303489 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b194538d-4cd2-4317-b044-30a5a83ebc9d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:31.304250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b194538d-4cd2-4317-b044-30a5a83ebc9d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:31.304682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b194538d-4cd2-4317-b044-30a5a83ebc9d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:31.447376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b194538d-4cd2-4317-b044-30a5a83ebc9d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:31.455221 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b194538d-4cd2-4317-b044-30a5a83ebc9d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1513 microversion: 2.1 time: 0.163448 Jun 17 07:39:31.457559 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 270/531] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:31 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:31.818076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b93678ec-79f5-4e0f-afc9-fc3009e3d2f2 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:31.818684 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b93678ec-79f5-4e0f-afc9-fc3009e3d2f2 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:31.824996 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b93678ec-79f5-4e0f-afc9-fc3009e3d2f2 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:31.825472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b93678ec-79f5-4e0f-afc9-fc3009e3d2f2 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:31.826231 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b93678ec-79f5-4e0f-afc9-fc3009e3d2f2 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:31.826659 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b93678ec-79f5-4e0f-afc9-fc3009e3d2f2 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:31.913383 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c7ec1829-ec87-4f18-a8a0-b341dd148516 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:31.914118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c7ec1829-ec87-4f18-a8a0-b341dd148516 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:31.920285 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c7ec1829-ec87-4f18-a8a0-b341dd148516 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:31.920736 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c7ec1829-ec87-4f18-a8a0-b341dd148516 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:31.921541 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c7ec1829-ec87-4f18-a8a0-b341dd148516 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:31.921984 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c7ec1829-ec87-4f18-a8a0-b341dd148516 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:31.945756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c7ec1829-ec87-4f18-a8a0-b341dd148516 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/ips" status: 200 len: 151 microversion: 2.20 time: 0.036707 Jun 17 07:39:31.946241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 271/532] 10.222.0.52 () {60 vars in 1288 bytes} [Fri Jun 17 07:39:31 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:39:31.963464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b93678ec-79f5-4e0f-afc9-fc3009e3d2f2 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:31.970963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b93678ec-79f5-4e0f-afc9-fc3009e3d2f2 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1444 microversion: 2.1 time: 0.157408 Jun 17 07:39:31.972091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 262/533] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:31 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:39:31.989186 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-59fb6d24-8431-4e20-9e63-674108021bdd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:31.990119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-59fb6d24-8431-4e20-9e63-674108021bdd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:31.996863 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-59fb6d24-8431-4e20-9e63-674108021bdd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:31.997314 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-59fb6d24-8431-4e20-9e63-674108021bdd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:31.998127 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-59fb6d24-8431-4e20-9e63-674108021bdd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:31.998563 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-59fb6d24-8431-4e20-9e63-674108021bdd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:32.133653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-59fb6d24-8431-4e20-9e63-674108021bdd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:32.141204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-59fb6d24-8431-4e20-9e63-674108021bdd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1444 microversion: 2.1 time: 0.156840 Jun 17 07:39:32.142265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 272/534] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:31 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:32.473892 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2ce4b136-f4df-4f12-9d4d-4af35e937889 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:32.474565 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2ce4b136-f4df-4f12-9d4d-4af35e937889 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:32.480717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2ce4b136-f4df-4f12-9d4d-4af35e937889 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:32.481157 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2ce4b136-f4df-4f12-9d4d-4af35e937889 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:32.481957 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2ce4b136-f4df-4f12-9d4d-4af35e937889 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:32.482385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2ce4b136-f4df-4f12-9d4d-4af35e937889 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:32.626433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2ce4b136-f4df-4f12-9d4d-4af35e937889 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:32.634791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2ce4b136-f4df-4f12-9d4d-4af35e937889 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1513 microversion: 2.1 time: 0.165704 Jun 17 07:39:32.635597 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 263/535] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:32 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:33.652338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-06f22a97-9cb7-42c9-84dd-02bd22f2f1c0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:33.653107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-06f22a97-9cb7-42c9-84dd-02bd22f2f1c0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:33.660526 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-06f22a97-9cb7-42c9-84dd-02bd22f2f1c0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:33.660974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-06f22a97-9cb7-42c9-84dd-02bd22f2f1c0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:33.661765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-06f22a97-9cb7-42c9-84dd-02bd22f2f1c0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:33.662196 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-06f22a97-9cb7-42c9-84dd-02bd22f2f1c0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:33.676982 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-829a5886-fd46-47ba-bd90-6e5f64de8131 req-ec92f760-589a-45a5-bddd-a693e30c2fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "556fcf69-50ad-45e3-b4dd-891ed7f57b74", "name": "network-vif-deleted", "tag": "c6c017b2-7ca6-4926-a228-a31d34e70e19"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:39:33.689702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-829a5886-fd46-47ba-bd90-6e5f64de8131 req-ec92f760-589a-45a5-bddd-a693e30c2fa5 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:33.690835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-829a5886-fd46-47ba-bd90-6e5f64de8131 req-ec92f760-589a-45a5-bddd-a693e30c2fa5 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:33.703527 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-829a5886-fd46-47ba-bd90-6e5f64de8131 req-ec92f760-589a-45a5-bddd-a693e30c2fa5 service nova] Creating event network-vif-deleted:c6c017b2-7ca6-4926-a228-a31d34e70e19 for instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 on hv-cinder-79733 Jun 17 07:39:33.709614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-829a5886-fd46-47ba-bd90-6e5f64de8131 req-ec92f760-589a-45a5-bddd-a693e30c2fa5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037640 Jun 17 07:39:33.710221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 264/536] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:39:33.791705 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-06f22a97-9cb7-42c9-84dd-02bd22f2f1c0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:33.805486 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-06f22a97-9cb7-42c9-84dd-02bd22f2f1c0 tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1471 microversion: 2.1 time: 0.157187 Jun 17 07:39:33.806080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 273/537] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:33 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:34.835742 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:34.836971 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:34.843693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:34.844374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:34.846926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:34.846926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:34.883753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:34.884588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:34.885276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lazy-loading 'fault' on Instance uuid 556fcf69-50ad-45e3-b4dd-891ed7f57b74 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:39:34.930761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4eeb8684c1e4c8da065e92fc5f04c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e64e39b616246e6974808d3d435e8ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:34.938165 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f16c89e8-ee1b-42fd-8466-6fa0aba7927d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 200 len: 1308 microversion: 2.1 time: 0.110147 Jun 17 07:39:34.938867 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 265/538] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:34 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:39:35.452151 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cee2781c-03e5-4886-ac8c-cdf6886ae988 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:39:35.452841 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cee2781c-03e5-4886-ac8c-cdf6886ae988 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:35.460192 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cee2781c-03e5-4886-ac8c-cdf6886ae988 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:35.460631 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cee2781c-03e5-4886-ac8c-cdf6886ae988 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:35.461420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cee2781c-03e5-4886-ac8c-cdf6886ae988 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:35.461849 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cee2781c-03e5-4886-ac8c-cdf6886ae988 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:35.484222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-cee2781c-03e5-4886-ac8c-cdf6886ae988 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lazy-loading 'flavor' on Instance uuid 69ad6743-cfda-46c3-afaa-6d54e2e80a2f {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:39:35.678522 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:35.748385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-379e5727-a38c-4a34-8404-92dd5f208fec req-62f73024-6243-468c-b542-c8ae6744be25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a5406c-f3f3-41ee-b763-cfcabfa91915", "tag": "745661a1-a356-4257-97ca-68167916d2cd"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:39:35.761668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-379e5727-a38c-4a34-8404-92dd5f208fec req-62f73024-6243-468c-b542-c8ae6744be25 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:35.762975 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-379e5727-a38c-4a34-8404-92dd5f208fec req-62f73024-6243-468c-b542-c8ae6744be25 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:35.773180 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-379e5727-a38c-4a34-8404-92dd5f208fec req-62f73024-6243-468c-b542-c8ae6744be25 service nova] Creating event network-changed:745661a1-a356-4257-97ca-68167916d2cd for instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 on hv-cinder-79733 Jun 17 07:39:35.778552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-379e5727-a38c-4a34-8404-92dd5f208fec req-62f73024-6243-468c-b542-c8ae6744be25 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033673 Jun 17 07:39:35.779162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 266/539] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:39:35.957810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:35.960047 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] [instance: 556fcf69-50ad-45e3-b4dd-891ed7f57b74] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:35.967742 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:35.968535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:35.969695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:35.970364 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:35.975537 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:35.985447 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] HTTP exception thrown: Instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 could not be found. Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Request method failure captured: Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 HTTP/1.1 Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC7GjbW3XitHtFxbNgYsKgInhXQ7dwUBuVDoykPCS5trF5Mru5_i_y0JhA3bq_gYP-tkphaDrkyZyYB75MyyvXLSdVIf5RZH5sWVKAVnz3a580uN82tyxqZmQf_cE6OhgiYKRT4L1trySf8GCE3aMkZemTde2ONDgah5pbDsBaIzrAU Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 9e64e39b616246e6974808d3d435e8ea Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1555455798 Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:39:35.988216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9e64e39b616246e6974808d3d435e8ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e64e39b616246e6974808d3d435e8ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9e64e39b616246e6974808d3d435e8ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9e64e39b616246e6974808d3d435e8ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-VolumesSnapshotTestJSON-1555455798 Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 9e64e39b616246e6974808d3d435e8ea Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1555455798 Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-VolumesSnapshotTestJSON-1555455798-project Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: d4eeb8684c1e4c8da065e92fc5f04c01 Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-VolumesSnapshotTestJSON-1555455798-project Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 could not be found. Jun 17 07:39:35.989938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '556fcf69-50ad-45e3-b4dd-891ed7f57b74'} Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 could not be found. Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:39:35.991135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 could not be found. Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 could not be found. Jun 17 07:39:35.992914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:39:35.999554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] Returning 404 to user: Instance 556fcf69-50ad-45e3-b4dd-891ed7f57b74 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:39:35.999554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-81ab8380-c797-40b7-a123-8c5669c6098d tempest-VolumesSnapshotTestJSON-1555455798 tempest-VolumesSnapshotTestJSON-1555455798-project] 10.222.0.52 "GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74" status: 404 len: 111 microversion: 2.1 time: 0.040943 Jun 17 07:39:35.999554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 267/540] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:39:35 2022] GET /compute/v2.1/servers/556fcf69-50ad-45e3-b4dd-891ed7f57b74 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:39:36.100169 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cee2781c-03e5-4886-ac8c-cdf6886ae988 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/action" status: 202 len: 0 microversion: 2.20 time: 0.651889 Jun 17 07:39:36.102110 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 274/541] 10.222.0.52 () {62 vars in 1318 bytes} [Fri Jun 17 07:39:35 2022] POST /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:39:36.110806 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:36.112227 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:36.120328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:36.121199 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:36.122160 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:36.122803 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:36.287053 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:36.295388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:36.297161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:36.298361 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3f8dc431-b3a7-46ea-a47d-9259dc4ca0d0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.191736 Jun 17 07:39:36.298908 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 268/542] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:36 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:37.488457 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:37.489247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:37.495719 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:37.496316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:37.497233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:37.497704 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:37.656030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:37.660810 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:37.662418 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:37.663730 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0d93db10-5874-4dc3-b5de-3afd34262d63 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.349867 Jun 17 07:39:37.674614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 275/543] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:37 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:38.682733 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:38.683337 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:38.690206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:38.690649 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:38.691435 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:38.691865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:38.826341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:38.835522 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:38.837043 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:38.838256 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a138f1ca-0260-45d8-8c3a-50aee267094b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.159862 Jun 17 07:39:38.838816 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 269/544] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:38 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:39.124735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:39:39.124953 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Fri Jun 17 07:39:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:39:39.859648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:39.860327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:39.869095 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:39.869860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:39.871583 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:39.872300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:40.015651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:40.023525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:40.025030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:40.026215 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f0d6532b-6d64-4823-97e9-7d97b0769190 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.171456 Jun 17 07:39:40.026815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 276/545] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:39 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:41.044248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:41.044806 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:41.047150 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:41.052598 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:41.053040 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:41.053848 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:41.054281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:41.187942 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:41.196274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:41.197813 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:41.199027 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a5dd34db-f65d-4200-a2be-0bafa88a0c3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.158883 Jun 17 07:39:41.199642 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 270/546] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:41 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:42.217731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:42.218330 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:42.225556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:42.225995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:42.226736 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:42.227159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:42.356746 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:42.365022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:42.366883 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:42.368036 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7ddc8b5b-5979-44a3-99f9-970331425338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.154167 Jun 17 07:39:42.368589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 277/547] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:42 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:43.387416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:43.388047 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:43.395600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:43.396046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:43.396842 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:43.397276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:43.525222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:43.533209 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:43.534868 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:43.536348 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0ba29b08-4691-481a-853a-14455ec7a695 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.152854 Jun 17 07:39:43.536926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 271/548] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:43 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:44.555213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:44.555787 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:44.562571 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:44.563012 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:44.564036 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:44.564504 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:44.705208 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:44.721546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:44.724905 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:44.727039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d9047cf7-e320-4e48-80f8-b0b4febdbc82 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.175690 Jun 17 07:39:44.727987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 278/549] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:44 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:45.746285 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:45.747013 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:45.754062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:45.754513 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:45.755282 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:45.755718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:45.886324 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:45.899864 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:45.901384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:45.902549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d36eb5fb-1af3-4127-ad48-8f02fc1d3683 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.160222 Jun 17 07:39:45.903095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 272/550] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:45 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:46.920284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:46.920956 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:46.923445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=42 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:39:46.929548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:46.932446 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:46.932446 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:46.932446 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:47.064517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:47.072681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:47.074214 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:47.075360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b6115132-034c-4d35-bbdf-4a3ab355591e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.158986 Jun 17 07:39:47.075923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 279/551] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:46 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:48.092935 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:48.093605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:48.100867 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:48.101313 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:48.102095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:48.102533 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:48.235017 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:48.243183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:48.244741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:48.245922 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-771b7c0f-2ff7-44a6-a59b-2b0c0e0fc52b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.156853 Jun 17 07:39:48.246478 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 273/552] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:48 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:49.264780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:49.265415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:49.272773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:49.273221 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:49.274007 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:49.274442 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:49.402455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:49.411003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:49.412511 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:49.413688 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2ccc2cb6-d266-417f-8d04-db07c2f81fec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.152833 Jun 17 07:39:49.414244 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 280/553] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:49 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:50.432523 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:50.433221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:50.440113 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:50.440571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:50.441641 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:50.442321 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:50.574801 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:50.582703 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:50.584234 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:50.585401 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2854939f-6f69-4905-b994-bd5ab7221b6b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.157047 Jun 17 07:39:50.585954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 274/554] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:50 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:39:51.603614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:51.604250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:51.610779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:51.611222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:51.611974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:51.612923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:51.748739 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:51.757623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:51.759123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:51.760263 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b1383142-04e1-46a5-bc27-9ab0d1d49244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.160569 Jun 17 07:39:51.760829 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 281/555] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:51 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:52.777862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:52.778469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:52.785561 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:52.786000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:52.786755 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:52.787183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:52.922876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:52.930865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:52.932360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:52.933588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0c5fae5a-0c71-435f-ad42-4849b2c3a95b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.159516 Jun 17 07:39:52.934088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 275/556] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:52 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:53.951657 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:53.952256 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:53.960483 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:53.960927 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:53.961707 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:53.962138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:54.094382 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:54.103030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:54.104527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:54.105709 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4ec3818a-b7ec-4027-87ab-7701d4ad38c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.157959 Jun 17 07:39:54.106267 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 282/557] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:53 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:39:55.124445 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:55.125041 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:55.131614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:55.132061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:55.132823 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:55.133262 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:55.261770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:55.270473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:55.273296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:55.273296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b7bed9d9-56ac-44a4-b701-26e144e4016e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.152598 Jun 17 07:39:55.273671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 276/558] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:55 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:56.291952 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:56.292481 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:56.299110 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:56.299565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:56.300321 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:56.300788 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:56.434262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:56.442316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:56.443832 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:56.444981 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4aadae34-4b67-4be0-9858-f164a6eecf0e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.157080 Jun 17 07:39:56.445574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 283/559] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:56 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:57.462514 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:57.463171 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:57.469667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:57.470111 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:57.470858 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:57.471301 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:57.605894 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:57.613773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:57.616451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:57.617678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-51b25d1a-6e5e-43c9-bec3-2b5c0d699095 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.158983 Jun 17 07:39:57.622208 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 277/560] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:57 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:58.636842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:58.637575 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:58.644062 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:58.644503 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:58.645256 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:58.646356 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:58.779412 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:58.787518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:58.789021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:58.790217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-589062ad-30dd-466a-85c2-e1580c397812 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.157490 Jun 17 07:39:58.790780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 284/561] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:58 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:39:59.810136 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:39:59.810661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:39:59.817338 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:59.817811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:59.819167 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:39:59.819964 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:39:59.947319 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:59.955688 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:59.957235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:39:59.958416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-325bda6c-c4b5-4c81-a773-13793e659cd8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.153699 Jun 17 07:39:59.958965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 278/562] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:39:59 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:00.978004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:00.978550 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:00.985651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:00.986313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:00.987128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:00.987584 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:01.120716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:01.128582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:01.130117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:01.131311 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0a07b1f1-8500-41f8-b195-c80d03b62244 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.158165 Jun 17 07:40:01.131906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 285/563] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:00 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:02.151528 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:02.152147 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:02.158785 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:02.159232 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:02.160067 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:02.160433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:02.296206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:02.304372 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:02.306119 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:02.307294 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f3f5949d-9a5f-49e2-a2a9-62edb049570a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.160921 Jun 17 07:40:02.307853 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 279/564] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:02 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:03.326127 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:03.326757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:03.333640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:03.334092 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:03.335359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:03.335848 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:03.470763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:03.479544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:03.481038 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:03.482229 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-407db167-9a2f-4135-8f41-84ffd13129bc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.160363 Jun 17 07:40:03.482774 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 286/565] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:03 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:04.500441 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:04.501044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:04.507084 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:04.507532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:04.508277 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:04.508704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:04.642523 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:04.650825 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:04.652379 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:04.653648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-91622458-7f8d-46ef-90cc-c581a7a0644b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1742 microversion: 2.20 time: 0.157135 Jun 17 07:40:04.654204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 280/566] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:04 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:05.681155 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:05.682419 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:05.783909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:05.783909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:05.783909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:05.783909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:05.871690 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:05.881376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:05.883367 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:05.884644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8c4ac2a7-1996-427d-997f-42f6f99237ab tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1742 microversion: 2.20 time: 0.208457 Jun 17 07:40:05.885207 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 287/567] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:05 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:06.904440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:06.905112 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:06.911820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:06.912263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:06.913037 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:06.913508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:07.041810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:07.049671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:07.051194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:07.052357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c457a06f-a305-493f-b6d2-ad340adf7ea8 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1742 microversion: 2.20 time: 0.151817 Jun 17 07:40:07.052921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 281/568] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:06 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:08.071821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:08.072364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:08.078929 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:08.079372 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:08.080143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:08.080571 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:08.084836 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=81 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:08.230165 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:08.238207 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:08.239952 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:08.241710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-89d648af-48a6-4691-98e0-ecba8ee606c2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1742 microversion: 2.20 time: 0.174113 Jun 17 07:40:08.242278 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 288/569] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:08 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:09.260737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:09.266533 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:09.267868 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:09.268360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:09.269107 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:09.269568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:09.274360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=86 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:09.418498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:09.426822 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:09.428957 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:09.430112 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0422f120-c86b-41a1-9d25-7dec8a6f7690 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1742 microversion: 2.20 time: 0.173999 Jun 17 07:40:09.430706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 282/570] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:09 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:09.729510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-c8225432-5baa-4337-84fd-b1a35319df3f req-a799a4a6-69f0-4062-b98c-5997dae59a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ad6743-cfda-46c3-afaa-6d54e2e80a2f", "name": "network-vif-plugged", "status": "completed", "tag": "1ce3a745-be88-4264-b1e5-51f76662590d"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:40:09.738843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c8225432-5baa-4337-84fd-b1a35319df3f req-a799a4a6-69f0-4062-b98c-5997dae59a8f service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:09.742804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c8225432-5baa-4337-84fd-b1a35319df3f req-a799a4a6-69f0-4062-b98c-5997dae59a8f service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:09.751614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-c8225432-5baa-4337-84fd-b1a35319df3f req-a799a4a6-69f0-4062-b98c-5997dae59a8f service nova] Creating event network-vif-plugged:1ce3a745-be88-4264-b1e5-51f76662590d for instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f on hv-cinder-79733 Jun 17 07:40:09.756872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-c8225432-5baa-4337-84fd-b1a35319df3f req-a799a4a6-69f0-4062-b98c-5997dae59a8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032195 Jun 17 07:40:09.757412 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 289/571] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:40:10.448693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:10.449242 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:10.455770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:10.456192 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:10.456981 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:10.457435 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:10.593116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:10.601204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:10.610327 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:10.610327 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0bc34f99-6f9f-47a3-a6f8-3595ae3caea1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1742 microversion: 2.20 time: 0.159805 Jun 17 07:40:10.610327 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 283/572] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:10 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:11.628473 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:11.629192 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:11.636090 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:11.636533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:11.637309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:11.637769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:11.771932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:11.779991 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:11.781541 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:11.782715 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-afbd850f-bdc9-4591-b6a2-d9d7bf29fd78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1742 microversion: 2.20 time: 0.159031 Jun 17 07:40:11.783278 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 290/573] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:11 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:12.801452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:12.802063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:12.804435 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=28 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:12.813598 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:12.815464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:12.815464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:12.815464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:12.945698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:12.954570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:12.956076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:12.957233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d1d5e661-f3f4-40af-b1a8-f6a43fcdbc78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1742 microversion: 2.20 time: 0.159802 Jun 17 07:40:12.957812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 284/574] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:12 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:13.975488 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:13.976067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:13.982676 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:13.983121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:13.983949 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:13.984348 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:14.119700 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:14.128664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:14.130309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:14.131354 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e1138118-b979-4fdd-9510-92d3742211eb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.159800 Jun 17 07:40:14.131920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 291/575] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:13 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:15.152098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:15.153394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:15.160512 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:15.161214 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:15.162118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:15.162567 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:15.317568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:15.325569 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:15.327067 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:15.328221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f131781d-c5f7-4761-b574-9b9a01898f6f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.181331 Jun 17 07:40:15.328788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 285/576] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:15 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:16.347090 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:16.348607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:16.356686 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:16.357156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:16.357945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:16.358377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:16.500626 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:16.509287 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:16.510878 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:16.512034 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1ca514d1-f193-41a2-a03e-bb7e69ae417a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.169498 Jun 17 07:40:16.512586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 292/577] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:16 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:17.538652 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:17.539300 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:17.547314 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:17.547765 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:17.548568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:17.549008 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:17.693663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:17.703615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:17.705103 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:17.706284 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-76037c37-358f-4bdf-815b-2681ca313e89 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.178902 Jun 17 07:40:17.706840 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 286/578] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:17 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:18.724510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:18.725109 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:18.728322 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=28 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:18.733267 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:18.733734 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:18.734477 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:18.734906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:18.874726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:18.883938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:18.885463 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:18.886854 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-00dc55a3-130b-4bc2-9e91-83d107872168 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.166357 Jun 17 07:40:18.897869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 293/579] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:18 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:19.907854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:19.915252 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:19.915900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:19.916526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:19.917609 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:19.918280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:20.078470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:20.088556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:20.090126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:20.091312 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8051dbde-bcb6-44b7-9948-c09b53d61821 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.187844 Jun 17 07:40:20.094379 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 287/580] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:19 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:21.111218 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:21.111828 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:21.120732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:21.122139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:21.124281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:21.124883 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:21.277154 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:21.284946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:21.286472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:21.287647 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-359318e1-ffc0-4448-b7ed-606b4009e41f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.180820 Jun 17 07:40:21.288231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 294/581] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:21 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:22.308267 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:22.308829 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:22.315379 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:22.315835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:22.316593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:22.317030 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:22.711812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:22.720376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:22.722094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:22.723247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9b962502-8e93-4a39-a0c4-e3ed994adc11 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.419700 Jun 17 07:40:22.724316 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 288/582] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:22 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:23.743266 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:23.743884 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:23.750281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:23.750743 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:23.751536 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:23.751966 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:23.897103 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:23.905849 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:23.907354 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:23.908508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3f8d5aff-a71a-4a20-a515-5f6e8315f75e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.169921 Jun 17 07:40:23.909087 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 295/583] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:23 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:24.927686 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:24.928236 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:24.936523 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:24.937210 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:24.938054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:24.938491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:25.084391 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:25.095248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:25.096750 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:25.097957 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a9f40c48-a212-4af7-a827-7d729589ac3a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.174742 Jun 17 07:40:25.103923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 289/584] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:24 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:26.117734 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:26.120957 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:26.128143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:26.128591 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:26.129573 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:26.130020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:26.315111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:26.324019 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:26.325546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:26.326722 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fa92d1d3-1f62-40e3-94ba-cc0a19ebe1e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.214427 Jun 17 07:40:26.327277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 296/585] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:26 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:26.726760 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bedb4b12-5e6c-4fb7-a0a2-0567494b4cac tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:26.727323 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bedb4b12-5e6c-4fb7-a0a2-0567494b4cac tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:26.733865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bedb4b12-5e6c-4fb7-a0a2-0567494b4cac tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:26.734320 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bedb4b12-5e6c-4fb7-a0a2-0567494b4cac tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:26.735086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bedb4b12-5e6c-4fb7-a0a2-0567494b4cac tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:26.735532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bedb4b12-5e6c-4fb7-a0a2-0567494b4cac tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:26.759359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bedb4b12-5e6c-4fb7-a0a2-0567494b4cac tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/ips" status: 200 len: 146 microversion: 2.1 time: 0.036482 Jun 17 07:40:26.759932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 290/586] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:40:26 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:40:27.348370 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:27.349111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:27.356589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:27.357123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:27.358031 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:27.358527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:27.508511 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:27.517623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:27.519346 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:27.520567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5cf47390-d536-44fa-8195-3f1c8902be83 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.176452 Jun 17 07:40:27.521352 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 297/587] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:27 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:28.538049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:28.538712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:28.545456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:28.545907 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:28.546668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:28.547109 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:28.684290 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:28.692312 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:28.693936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:28.695084 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6d437e62-3b37-42d0-a92d-c9bb49d30d86 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1737 microversion: 2.20 time: 0.160977 Jun 17 07:40:28.695635 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 291/588] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:28 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:29.714891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:29.715671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:29.722476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:29.722916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:29.723675 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:29.724102 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:29.956809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:29.965747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:29.967248 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:29.968406 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-52330409-8778-4338-b531-775d0889497b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1719 microversion: 2.20 time: 0.258003 Jun 17 07:40:29.968974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 298/589] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:29 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1719 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:30.606490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3c34cce3-860d-4151-9884-69a72a17cfcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c19dce6-c718-400a-a07c-2cbb7dde0d31"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:40:30.607546 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3c34cce3-860d-4151-9884-69a72a17cfcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:30.614008 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c34cce3-860d-4151-9884-69a72a17cfcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:30.614458 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c34cce3-860d-4151-9884-69a72a17cfcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:30.615209 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c34cce3-860d-4151-9884-69a72a17cfcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:30.615641 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c34cce3-860d-4151-9884-69a72a17cfcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:30.987040 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:30.987615 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:30.994503 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:30.994940 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:30.995681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:30.996109 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:31.129337 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:31.137527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:31.139111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:31.140261 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-13be13f4-0c0b-471b-bf56-e2f5c5fb6104 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1719 microversion: 2.20 time: 0.157144 Jun 17 07:40:31.140826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 299/590] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:30 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:32.161908 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:32.162524 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:32.169089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:32.169581 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:32.170343 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:32.170778 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:32.302639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:32.310774 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:32.312309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:32.313500 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ec3601fa-89d2-4b1a-9754-ff04826d161b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1719 microversion: 2.20 time: 0.155561 Jun 17 07:40:32.314101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 300/591] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:32 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:32.354172 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3c34cce3-860d-4151-9884-69a72a17cfcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.751797 Jun 17 07:40:32.354863 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 292/592] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:40:30 2022] POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/os-volume_attachments => generated 194 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:40:33.333204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:33.333846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:33.341019 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:33.341498 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:33.342315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:33.342752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:33.494716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:33.502582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:33.504060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:33.505204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fabe6f3c-593c-43b9-ab5c-80e96feff8b1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1662 microversion: 2.20 time: 0.175960 Jun 17 07:40:33.505846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 301/593] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:33 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1662 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:33.524511 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-85d9cd3d-5868-4282-838a-577b1a9d7be2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "385921b4-affe-4e4b-99d5-8d41b58be9c8"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:40:33.526089 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-85d9cd3d-5868-4282-838a-577b1a9d7be2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:33.532543 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85d9cd3d-5868-4282-838a-577b1a9d7be2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:33.532987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85d9cd3d-5868-4282-838a-577b1a9d7be2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:33.533776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85d9cd3d-5868-4282-838a-577b1a9d7be2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:33.534217 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85d9cd3d-5868-4282-838a-577b1a9d7be2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:33.925884 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-5f7a90a3-cae7-4141-b389-05dd41656ad2 req-9cb149e0-6005-40bf-a63b-3dc69375c8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ad6743-cfda-46c3-afaa-6d54e2e80a2f", "name": "network-vif-unplugged", "status": "completed", "tag": "1ce3a745-be88-4264-b1e5-51f76662590d"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:40:33.934676 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-5f7a90a3-cae7-4141-b389-05dd41656ad2 req-9cb149e0-6005-40bf-a63b-3dc69375c8cc service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:33.935112 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-5f7a90a3-cae7-4141-b389-05dd41656ad2 req-9cb149e0-6005-40bf-a63b-3dc69375c8cc service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:33.946503 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.compute.server_external_events [req-5f7a90a3-cae7-4141-b389-05dd41656ad2 req-9cb149e0-6005-40bf-a63b-3dc69375c8cc service nova] Unable to find a host for instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f. Dropping event network-vif-unplugged {{(pid=124472) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 07:40:33.947478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-5f7a90a3-cae7-4141-b389-05dd41656ad2 req-9cb149e0-6005-40bf-a63b-3dc69375c8cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.145268 Jun 17 07:40:33.948490 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 302/594] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 147 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 17 07:40:34.669236 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-85d9cd3d-5868-4282-838a-577b1a9d7be2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.149947 Jun 17 07:40:34.670107 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 293/595] 10.222.0.52 () {62 vars in 1363 bytes} [Fri Jun 17 07:40:33 2022] POST /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments => generated 188 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:40:34.784351 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-099616be-e292-412f-b34a-1d90544b97dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:40:34.784915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-099616be-e292-412f-b34a-1d90544b97dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:34.792240 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-099616be-e292-412f-b34a-1d90544b97dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:34.792691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-099616be-e292-412f-b34a-1d90544b97dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:34.793487 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-099616be-e292-412f-b34a-1d90544b97dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:34.793924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-099616be-e292-412f-b34a-1d90544b97dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:35.089283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-099616be-e292-412f-b34a-1d90544b97dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/action" status: 202 len: 0 microversion: 2.20 time: 0.308732 Jun 17 07:40:35.089930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 303/596] 10.222.0.52 () {62 vars in 1318 bytes} [Fri Jun 17 07:40:34 2022] POST /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:40:35.097965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:35.101306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:35.105409 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:35.105825 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:35.106592 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:35.107027 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:35.242422 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:35.251472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:35.252976 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:35.254175 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-628477a0-4d7d-4eff-ada0-d58411af3d07 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1748 microversion: 2.20 time: 0.160119 Jun 17 07:40:35.254766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 294/597] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:35 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:36.273374 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:36.273979 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:36.280223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:36.280666 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:36.281441 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:36.281874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:36.413430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:36.422119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:36.423612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:36.424740 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4ec1aa03-702a-42ab-83e5-5e595d1b2bf0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1748 microversion: 2.20 time: 0.155831 Jun 17 07:40:36.425286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 304/598] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:36 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:37.443565 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:37.444282 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:37.450831 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:37.451274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:37.452028 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:37.452462 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:37.455090 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:37.580654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:37.588847 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:37.590359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:37.591502 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-28315cc8-8968-4e4d-af88-3dfd397b1060 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1748 microversion: 2.20 time: 0.151854 Jun 17 07:40:37.592057 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 295/599] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:37 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:38.609651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:38.610259 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:38.617022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:38.617504 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:38.618264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:38.619242 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:38.623118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:38.754915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:38.764079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:38.765607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:38.766758 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0c888ceb-ed85-4b29-960d-3c1ecfa37794 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1748 microversion: 2.20 time: 0.161003 Jun 17 07:40:38.767310 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 305/600] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:38 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:39.784428 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:39.785051 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:39.796346 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:39.796803 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:39.797602 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:39.798268 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:39.928901 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:39.938142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:39.939651 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:39.940840 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5a5e6449-9037-4c89-a912-101813ffc8b4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1748 microversion: 2.20 time: 0.160369 Jun 17 07:40:39.941422 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 296/601] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:39 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:40.914899 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a9758991-8253-41d4-affd-6db4ad9725cd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:40:40.922297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a9758991-8253-41d4-affd-6db4ad9725cd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:40.926034 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a9758991-8253-41d4-affd-6db4ad9725cd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:40.958861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:40.959423 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:40.966653 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:40.967104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:40.967882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:40.968319 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:40.984263 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a9758991-8253-41d4-affd-6db4ad9725cd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Going to try to stop instance {{(pid=124472) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 07:40:41.108631 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:41.117388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:41.119557 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:41.120731 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-af87aba7-f5fb-49cd-bb97-fd79a4c12131 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1750 microversion: 2.20 time: 0.166156 Jun 17 07:40:41.121272 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 297/602] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:40 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:41.184733 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a9758991-8253-41d4-affd-6db4ad9725cd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/action" status: 202 len: 0 microversion: 2.1 time: 0.273534 Jun 17 07:40:41.185018 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 306/603] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:40:40 2022] POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:40:41.193281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-eda8226e-303b-469d-a421-90e15b79dbd7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:41.193945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-eda8226e-303b-469d-a421-90e15b79dbd7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:41.200783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eda8226e-303b-469d-a421-90e15b79dbd7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:41.201230 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eda8226e-303b-469d-a421-90e15b79dbd7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:41.202014 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eda8226e-303b-469d-a421-90e15b79dbd7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:41.202452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-eda8226e-303b-469d-a421-90e15b79dbd7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:41.330946 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-eda8226e-303b-469d-a421-90e15b79dbd7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:41.339145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-eda8226e-303b-469d-a421-90e15b79dbd7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.149668 Jun 17 07:40:41.339711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 298/604] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:41 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:42.140966 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:42.141719 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:42.147823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:42.148274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:42.149035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:42.149509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:42.281169 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:42.289434 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:42.290921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:42.292068 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9579bb23-fd75-4d67-bde7-7adeb7d043bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1750 microversion: 2.20 time: 0.155923 Jun 17 07:40:42.292616 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 307/605] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:42 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:42.356221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d6d4bf99-913d-4790-af12-63497bc00503 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:42.357159 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d6d4bf99-913d-4790-af12-63497bc00503 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:42.363258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d6d4bf99-913d-4790-af12-63497bc00503 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:42.363963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d6d4bf99-913d-4790-af12-63497bc00503 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:42.364771 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d6d4bf99-913d-4790-af12-63497bc00503 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:42.365200 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d6d4bf99-913d-4790-af12-63497bc00503 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:42.497846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d6d4bf99-913d-4790-af12-63497bc00503 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:42.505872 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d6d4bf99-913d-4790-af12-63497bc00503 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.153649 Jun 17 07:40:42.506444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 299/606] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:42 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:40:43.313378 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:43.314064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:43.320564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:43.321258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:43.322909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:43.323347 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:43.524410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b6c31bee-6bd5-4d84-a092-71df032e8273 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:43.524980 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b6c31bee-6bd5-4d84-a092-71df032e8273 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:43.527678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=32 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:43.532449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b6c31bee-6bd5-4d84-a092-71df032e8273 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:43.532900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b6c31bee-6bd5-4d84-a092-71df032e8273 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:43.533721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b6c31bee-6bd5-4d84-a092-71df032e8273 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:43.534153 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b6c31bee-6bd5-4d84-a092-71df032e8273 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:43.672497 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b6c31bee-6bd5-4d84-a092-71df032e8273 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:43.680904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b6c31bee-6bd5-4d84-a092-71df032e8273 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.160525 Jun 17 07:40:43.682553 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 300/607] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:43 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:40:43.757095 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:43.765588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:43.767077 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:43.768226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a2e1ad04-a2fa-4555-ac39-357bb4c87d6a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.458792 Jun 17 07:40:43.768784 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 308/608] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:43 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:44.700720 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-96256d9b-ddc7-4c67-a8e5-6c12528e9160 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:44.701263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-96256d9b-ddc7-4c67-a8e5-6c12528e9160 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:44.713845 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-96256d9b-ddc7-4c67-a8e5-6c12528e9160 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:44.714785 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-96256d9b-ddc7-4c67-a8e5-6c12528e9160 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:44.716536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-96256d9b-ddc7-4c67-a8e5-6c12528e9160 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:44.717370 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-96256d9b-ddc7-4c67-a8e5-6c12528e9160 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:44.787517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:44.789573 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:44.799255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:44.799893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:44.801050 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:44.801844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:44.910266 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-96256d9b-ddc7-4c67-a8e5-6c12528e9160 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:44.919095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-96256d9b-ddc7-4c67-a8e5-6c12528e9160 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.223018 Jun 17 07:40:44.919901 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 301/609] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:44 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:44.975833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:44.985693 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:44.987183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:44.988629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a437f660-3bac-4afd-b3aa-a0861ba3fec7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.205476 Jun 17 07:40:44.989414 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 309/610] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:44 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:45.937023 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dcbac997-c8ce-4faa-8cde-8e48bc7e04df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:45.937623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dcbac997-c8ce-4faa-8cde-8e48bc7e04df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:45.944005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dcbac997-c8ce-4faa-8cde-8e48bc7e04df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:45.944451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dcbac997-c8ce-4faa-8cde-8e48bc7e04df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:45.945204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dcbac997-c8ce-4faa-8cde-8e48bc7e04df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:45.945657 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dcbac997-c8ce-4faa-8cde-8e48bc7e04df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:46.008114 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:46.008729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:46.015824 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:46.016270 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:46.017040 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:46.017511 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:46.095046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-dcbac997-c8ce-4faa-8cde-8e48bc7e04df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:46.103116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dcbac997-c8ce-4faa-8cde-8e48bc7e04df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.169900 Jun 17 07:40:46.107715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 302/611] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:45 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:46.156813 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:46.165517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:46.168107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:46.169297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4e9f2992-3668-41ae-9994-701a5b5ea47b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.165147 Jun 17 07:40:46.169883 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 310/612] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:46 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:47.120098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-03462ac8-a91d-424d-bdfb-4efeccf16243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:47.120681 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-03462ac8-a91d-424d-bdfb-4efeccf16243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:47.127398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03462ac8-a91d-424d-bdfb-4efeccf16243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:47.127871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03462ac8-a91d-424d-bdfb-4efeccf16243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:47.128648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03462ac8-a91d-424d-bdfb-4efeccf16243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:47.129095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03462ac8-a91d-424d-bdfb-4efeccf16243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:47.189304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:47.190370 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:47.198551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:47.199101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:47.200119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:47.200626 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:47.295490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-03462ac8-a91d-424d-bdfb-4efeccf16243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:47.304548 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-03462ac8-a91d-424d-bdfb-4efeccf16243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.188182 Jun 17 07:40:47.305136 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 303/613] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:47 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:47.356927 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:47.365943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:47.367430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:47.368957 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0f9b1062-e2b7-4ea6-9e4b-b6dd288afa42 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.184844 Jun 17 07:40:47.369866 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 311/614] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:47 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:48.323239 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e6d4eb7f-835e-46f6-a214-b2f4bdbd7540 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:48.324190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e6d4eb7f-835e-46f6-a214-b2f4bdbd7540 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:48.330968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6d4eb7f-835e-46f6-a214-b2f4bdbd7540 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:48.331410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6d4eb7f-835e-46f6-a214-b2f4bdbd7540 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:48.332169 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6d4eb7f-835e-46f6-a214-b2f4bdbd7540 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:48.332599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6d4eb7f-835e-46f6-a214-b2f4bdbd7540 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:48.392528 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:48.393184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:48.403211 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:48.404037 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:48.404983 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:48.405460 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:48.482352 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e6d4eb7f-835e-46f6-a214-b2f4bdbd7540 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:48.495237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e6d4eb7f-835e-46f6-a214-b2f4bdbd7540 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.176504 Jun 17 07:40:48.495829 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 304/615] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:48 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:48.559263 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:48.567600 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:48.569083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:48.570250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c35474e4-4e95-4f06-aeae-4500d4a3362e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.182780 Jun 17 07:40:48.570804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 312/616] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:48 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:49.512835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-791d71ae-d2ad-4a66-95d1-d1014c0821e3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:49.514465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-791d71ae-d2ad-4a66-95d1-d1014c0821e3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:49.520955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-791d71ae-d2ad-4a66-95d1-d1014c0821e3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:49.521531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-791d71ae-d2ad-4a66-95d1-d1014c0821e3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:49.522379 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-791d71ae-d2ad-4a66-95d1-d1014c0821e3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:49.522888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-791d71ae-d2ad-4a66-95d1-d1014c0821e3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:49.588603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:49.589223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:49.595329 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=42 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:49.596789 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:49.597583 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:49.598715 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:49.599422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:49.672229 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-791d71ae-d2ad-4a66-95d1-d1014c0821e3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:49.686550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-791d71ae-d2ad-4a66-95d1-d1014c0821e3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.176444 Jun 17 07:40:49.686853 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 305/617] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:49 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:49.779589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:49.790101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:49.792232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:49.793453 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1fc8513a-233c-49be-93a5-52d616996725 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.209349 Jun 17 07:40:49.794032 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 313/618] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:49 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:50.702701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f8201635-1ce9-45e2-acc4-ff95a01dccfd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:50.703318 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f8201635-1ce9-45e2-acc4-ff95a01dccfd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:50.710567 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f8201635-1ce9-45e2-acc4-ff95a01dccfd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:50.711021 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f8201635-1ce9-45e2-acc4-ff95a01dccfd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:50.712155 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f8201635-1ce9-45e2-acc4-ff95a01dccfd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:50.712621 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f8201635-1ce9-45e2-acc4-ff95a01dccfd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:50.812231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:50.813267 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:50.822814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:50.824049 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:50.824982 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:50.825546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:50.863588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f8201635-1ce9-45e2-acc4-ff95a01dccfd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:50.872787 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f8201635-1ce9-45e2-acc4-ff95a01dccfd tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.174475 Jun 17 07:40:50.873418 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 306/619] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:50 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:50.971327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:50.979816 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:50.981308 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:50.982495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cfa37c06-1292-47ee-8051-2282036888e6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.174234 Jun 17 07:40:50.983051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 314/620] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:50 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:51.890779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c134338c-d190-418c-ae62-996a7afe5e52 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:51.891420 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c134338c-d190-418c-ae62-996a7afe5e52 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:51.898227 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c134338c-d190-418c-ae62-996a7afe5e52 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:51.898675 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c134338c-d190-418c-ae62-996a7afe5e52 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:51.899492 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c134338c-d190-418c-ae62-996a7afe5e52 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:51.899941 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c134338c-d190-418c-ae62-996a7afe5e52 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:52.002682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:52.003380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:52.010573 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:52.011015 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:52.011781 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:52.012220 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:52.041658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c134338c-d190-418c-ae62-996a7afe5e52 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:52.050073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c134338c-d190-418c-ae62-996a7afe5e52 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.163148 Jun 17 07:40:52.050671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 307/621] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:51 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:52.158477 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:52.172362 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:52.173895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:52.175077 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e01e197b-2c2d-4a4c-9188-08753ae6c1dd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.177058 Jun 17 07:40:52.175861 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 315/622] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:51 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:53.068375 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f76dec7a-9acf-40a6-969e-1e08800fdfcf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:53.069773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f76dec7a-9acf-40a6-969e-1e08800fdfcf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:53.077547 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f76dec7a-9acf-40a6-969e-1e08800fdfcf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:53.078274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f76dec7a-9acf-40a6-969e-1e08800fdfcf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:53.079223 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f76dec7a-9acf-40a6-969e-1e08800fdfcf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:53.079822 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f76dec7a-9acf-40a6-969e-1e08800fdfcf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:53.193773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:53.194525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:53.201957 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:53.202406 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:53.203176 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:53.203620 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:53.231170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f76dec7a-9acf-40a6-969e-1e08800fdfcf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:53.242554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f76dec7a-9acf-40a6-969e-1e08800fdfcf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.178047 Jun 17 07:40:53.243187 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 308/623] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:53 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:53.347186 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:53.355955 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:53.357512 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:53.358668 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b08567d7-d246-4854-9cca-091d91b0017d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.168850 Jun 17 07:40:53.359330 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 316/624] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:53 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:54.260647 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ed2a4e00-fbc5-458d-884c-e3ef8b6b1b41 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:54.261297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ed2a4e00-fbc5-458d-884c-e3ef8b6b1b41 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:54.267903 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ed2a4e00-fbc5-458d-884c-e3ef8b6b1b41 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:54.268341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ed2a4e00-fbc5-458d-884c-e3ef8b6b1b41 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:54.269103 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ed2a4e00-fbc5-458d-884c-e3ef8b6b1b41 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:54.269596 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ed2a4e00-fbc5-458d-884c-e3ef8b6b1b41 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:54.378467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:54.379975 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:54.386601 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:54.387215 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:54.387999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:54.388434 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:54.413525 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ed2a4e00-fbc5-458d-884c-e3ef8b6b1b41 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:54.423129 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ed2a4e00-fbc5-458d-884c-e3ef8b6b1b41 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.166905 Jun 17 07:40:54.426528 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 309/625] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:54 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:54.543108 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:54.551592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:54.553064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:54.554236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-962e0413-c034-42e5-abc4-ddd88c42635d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.179758 Jun 17 07:40:54.554794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 317/626] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:54 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:55.443516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9fceb6bf-ad25-4ab1-8ae1-e9149d07228c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:55.444258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9fceb6bf-ad25-4ab1-8ae1-e9149d07228c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:55.451148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9fceb6bf-ad25-4ab1-8ae1-e9149d07228c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:55.451532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9fceb6bf-ad25-4ab1-8ae1-e9149d07228c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:55.452286 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9fceb6bf-ad25-4ab1-8ae1-e9149d07228c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:55.452727 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9fceb6bf-ad25-4ab1-8ae1-e9149d07228c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:55.572548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:55.573135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:55.579510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:55.579951 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:55.580703 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:55.581130 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:55.586014 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9fceb6bf-ad25-4ab1-8ae1-e9149d07228c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:55.594913 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9fceb6bf-ad25-4ab1-8ae1-e9149d07228c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.155239 Jun 17 07:40:55.595499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 310/627] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:55 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:55.716890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:55.725881 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:55.728142 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:55.729313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-69858a57-da2e-4546-aa40-677d784ff196 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.161204 Jun 17 07:40:55.729900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 318/628] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:55 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:56.613654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-040dec4f-4102-41f8-b86d-e761a59ac552 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:56.614352 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-040dec4f-4102-41f8-b86d-e761a59ac552 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:56.621204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-040dec4f-4102-41f8-b86d-e761a59ac552 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:56.621682 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-040dec4f-4102-41f8-b86d-e761a59ac552 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:56.622441 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-040dec4f-4102-41f8-b86d-e761a59ac552 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:56.622876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-040dec4f-4102-41f8-b86d-e761a59ac552 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:56.748599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:56.749253 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:56.754842 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-040dec4f-4102-41f8-b86d-e761a59ac552 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:56.755920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:56.756364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:56.757017 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:56.757177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:56.757763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:56.763956 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-040dec4f-4102-41f8-b86d-e761a59ac552 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.154508 Jun 17 07:40:56.764531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 311/629] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:56 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:56.894899 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:56.903554 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:56.905067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:56.906247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-47b62ebd-7082-4ed8-965e-30d79ea1e6e9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.161689 Jun 17 07:40:56.906814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 319/630] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:56 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:40:57.783577 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7fdf16ab-e839-48c6-a488-af7194ad3435 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:57.784171 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7fdf16ab-e839-48c6-a488-af7194ad3435 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:57.791444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7fdf16ab-e839-48c6-a488-af7194ad3435 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:57.791896 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7fdf16ab-e839-48c6-a488-af7194ad3435 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:57.792658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7fdf16ab-e839-48c6-a488-af7194ad3435 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:57.793097 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7fdf16ab-e839-48c6-a488-af7194ad3435 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:57.924588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:57.925183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7fdf16ab-e839-48c6-a488-af7194ad3435 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:57.925350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:57.932607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:57.934218 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:57.934218 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:57.934426 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7fdf16ab-e839-48c6-a488-af7194ad3435 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.156210 Jun 17 07:40:57.934548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:57.943327 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 312/631] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:57 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:58.064294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:58.066650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:40:58.073632 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:58.077506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:58.077506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a1ab8f34-83c1-4a9b-8a42-04622a4bde77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.155528 Jun 17 07:40:58.077506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 320/632] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:57 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:58.952109 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-89e22878-3b85-4708-95d2-bba02489df4f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:58.952718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-89e22878-3b85-4708-95d2-bba02489df4f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:58.959232 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-89e22878-3b85-4708-95d2-bba02489df4f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:58.959715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-89e22878-3b85-4708-95d2-bba02489df4f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:58.960483 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-89e22878-3b85-4708-95d2-bba02489df4f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:58.960925 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-89e22878-3b85-4708-95d2-bba02489df4f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:59.095483 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:40:59.096099 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:59.101834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-89e22878-3b85-4708-95d2-bba02489df4f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:59.104106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:59.104539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:59.105307 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:59.105769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:59.111568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-89e22878-3b85-4708-95d2-bba02489df4f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1724 microversion: 2.1 time: 0.163357 Jun 17 07:40:59.113873 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 313/633] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:40:58 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:40:59.245448 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:59.254150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:59.255677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:40:59.256823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-97674db2-a249-4cf7-aa9d-18af854362a7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.165904 Jun 17 07:40:59.257398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 321/634] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:40:59 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:40:59.331406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9f33eb1d-a087-4afc-a8a4-a3471d9364dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcccb341-4a43-441c-98e2-f49bc99bbc8d"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:40:59.332661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9f33eb1d-a087-4afc-a8a4-a3471d9364dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:40:59.339623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f33eb1d-a087-4afc-a8a4-a3471d9364dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:59.340074 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f33eb1d-a087-4afc-a8a4-a3471d9364dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:40:59.340895 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f33eb1d-a087-4afc-a8a4-a3471d9364dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:40:59.341345 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f33eb1d-a087-4afc-a8a4-a3471d9364dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:00.131857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6cdf3e18-32ca-49c6-b488-0d045cccb56c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:00.132460 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6cdf3e18-32ca-49c6-b488-0d045cccb56c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:00.139202 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6cdf3e18-32ca-49c6-b488-0d045cccb56c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:00.139641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6cdf3e18-32ca-49c6-b488-0d045cccb56c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:00.140394 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6cdf3e18-32ca-49c6-b488-0d045cccb56c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:00.140836 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6cdf3e18-32ca-49c6-b488-0d045cccb56c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:00.286332 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6cdf3e18-32ca-49c6-b488-0d045cccb56c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:00.295451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6cdf3e18-32ca-49c6-b488-0d045cccb56c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1701 microversion: 2.1 time: 0.167348 Jun 17 07:41:00.297931 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 322/635] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:00 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1701 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:41:00.303067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:00.303676 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:00.310380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:00.310913 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:00.311752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:00.312260 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:00.447193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:00.455950 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:00.457467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:00.458636 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-609471ef-fab7-433b-b6b2-681466b1b4f1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.159436 Jun 17 07:41:00.459205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 323/636] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:00 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:00.464633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-09197d0e-ea2b-4e48-b7dd-19fb487a696c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:41:00.470808 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-09197d0e-ea2b-4e48-b7dd-19fb487a696c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:00.474684 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-09197d0e-ea2b-4e48-b7dd-19fb487a696c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:00.496124 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-09197d0e-ea2b-4e48-b7dd-19fb487a696c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Going to try to start instance {{(pid=124472) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 07:41:00.689447 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-09197d0e-ea2b-4e48-b7dd-19fb487a696c tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/action" status: 202 len: 0 microversion: 2.1 time: 0.228995 Jun 17 07:41:00.690066 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 324/637] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:41:00 2022] POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:41:00.699546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f2c861aa-c5bb-4070-bb82-fb79096f9227 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:00.700237 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f2c861aa-c5bb-4070-bb82-fb79096f9227 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:00.706681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f2c861aa-c5bb-4070-bb82-fb79096f9227 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:00.711639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f2c861aa-c5bb-4070-bb82-fb79096f9227 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:00.711639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f2c861aa-c5bb-4070-bb82-fb79096f9227 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:00.711639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f2c861aa-c5bb-4070-bb82-fb79096f9227 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:00.848678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f2c861aa-c5bb-4070-bb82-fb79096f9227 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:00.857224 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f2c861aa-c5bb-4070-bb82-fb79096f9227 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1710 microversion: 2.1 time: 0.162692 Jun 17 07:41:00.857927 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 325/638] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:00 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:41:01.476643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:01.477983 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:01.486275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:01.486815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:01.487597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:01.488301 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:01.578968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9f33eb1d-a087-4afc-a8a4-a3471d9364dc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.363962 Jun 17 07:41:01.579762 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 314/639] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:40:59 2022] POST /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments => generated 194 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:41:01.671510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:01.681108 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:01.682941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:01.684160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d578fae0-4ee7-475b-8e29-b12c9c5326e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.211434 Jun 17 07:41:01.685614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 326/640] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:01 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:41:01.880763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c2454f50-3044-41c1-93b4-00c48a351f06 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:01.881401 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c2454f50-3044-41c1-93b4-00c48a351f06 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:01.888866 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2454f50-3044-41c1-93b4-00c48a351f06 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:01.889334 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2454f50-3044-41c1-93b4-00c48a351f06 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:01.890234 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2454f50-3044-41c1-93b4-00c48a351f06 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:01.890531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c2454f50-3044-41c1-93b4-00c48a351f06 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:02.032161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c2454f50-3044-41c1-93b4-00c48a351f06 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:02.044023 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c2454f50-3044-41c1-93b4-00c48a351f06 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1710 microversion: 2.1 time: 0.167530 Jun 17 07:41:02.044708 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 315/641] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:01 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:02.703705 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:02.704315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:02.711355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:02.711840 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:02.712918 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:02.713448 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:02.855310 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:02.864947 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:02.865943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:02.867193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-aa9c91b3-c8b2-4347-a10b-d73ee9aebe7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.167548 Jun 17 07:41:02.868527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 327/642] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:02 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:03.062365 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-22802e23-f883-40a6-86f9-b90fc32620df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:03.063459 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-22802e23-f883-40a6-86f9-b90fc32620df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:03.074993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-22802e23-f883-40a6-86f9-b90fc32620df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:03.075602 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-22802e23-f883-40a6-86f9-b90fc32620df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:03.076665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-22802e23-f883-40a6-86f9-b90fc32620df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:03.077099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-22802e23-f883-40a6-86f9-b90fc32620df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:03.222519 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-22802e23-f883-40a6-86f9-b90fc32620df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:03.232255 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-22802e23-f883-40a6-86f9-b90fc32620df tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1710 microversion: 2.1 time: 0.173980 Jun 17 07:41:03.232822 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 316/643] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:03 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:03.888623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:03.889228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:03.895763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:03.896200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:03.896950 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:03.897407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:04.032083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:04.040659 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:04.042175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:04.043347 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-820838cb-1bb8-4b30-84c1-3fd1d565d6c9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.158616 Jun 17 07:41:04.043941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 328/644] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:03 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:04.250023 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e6f67239-a0a0-4d94-9c84-dd45ef04aa8b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:04.250621 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e6f67239-a0a0-4d94-9c84-dd45ef04aa8b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:04.257058 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6f67239-a0a0-4d94-9c84-dd45ef04aa8b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:04.257615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6f67239-a0a0-4d94-9c84-dd45ef04aa8b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:04.259079 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6f67239-a0a0-4d94-9c84-dd45ef04aa8b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:04.259518 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6f67239-a0a0-4d94-9c84-dd45ef04aa8b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:04.393790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e6f67239-a0a0-4d94-9c84-dd45ef04aa8b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:04.403083 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e6f67239-a0a0-4d94-9c84-dd45ef04aa8b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1714 microversion: 2.1 time: 0.157023 Jun 17 07:41:04.403658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 317/645] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:04 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:05.061767 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:05.062437 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:05.068711 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:05.069177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:05.069952 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:05.070380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:05.217540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:05.226073 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:05.227653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:05.228940 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f0251950-4991-439b-aaa2-853ff2cd314d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.171143 Jun 17 07:41:05.229534 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 329/646] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:05 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:06.247764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:06.248495 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:06.255068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:06.255516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:06.256276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:06.256756 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:06.392030 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:06.401469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:06.403024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:06.404190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-121f76b5-b24a-47e0-a484-671d2c9033ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.160358 Jun 17 07:41:06.404766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 318/647] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:06 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:07.425309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:07.425921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:07.433293 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:07.439292 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:07.439292 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:07.439292 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:07.576722 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:07.585666 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:07.587291 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:07.588451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e2cada79-eda0-4846-8778-98ec05af9f69 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.167005 Jun 17 07:41:07.589018 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 330/648] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:07 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:08.607131 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:08.607739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:08.614658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:08.615105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:08.615869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:08.616307 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:08.754246 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:08.763391 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:08.764887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:08.766073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-52b4765c-0623-4b6b-9214-6c4f2a279453 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.162889 Jun 17 07:41:08.766634 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 319/649] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:08 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:09.784415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:09.785038 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:09.791923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:09.792366 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:09.793135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:09.793586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:09.937590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:09.946796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:09.948340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:09.949545 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ba43a887-5f1a-4f9f-b4c5-03977f0a8aed tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.169007 Jun 17 07:41:09.950372 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 331/650] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:09 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:10.172962 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6c27dec4-ebf4-4124-bd1b-c65f608cd5d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:41:10.174015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6c27dec4-ebf4-4124-bd1b-c65f608cd5d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:10.181811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c27dec4-ebf4-4124-bd1b-c65f608cd5d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:10.182283 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c27dec4-ebf4-4124-bd1b-c65f608cd5d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:10.183065 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c27dec4-ebf4-4124-bd1b-c65f608cd5d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:10.183504 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c27dec4-ebf4-4124-bd1b-c65f608cd5d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:10.209091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-6c27dec4-ebf4-4124-bd1b-c65f608cd5d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lazy-loading 'flavor' on Instance uuid c1866c92-f2f4-49e4-b391-ffca4b0ce35b {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:41:10.538393 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6c27dec4-ebf4-4124-bd1b-c65f608cd5d8 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/action" status: 200 len: 32 microversion: 2.1 time: 0.369409 Jun 17 07:41:10.538920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 320/651] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:41:10 2022] POST /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/action => generated 32 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:41:10.548614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b1b7cf11-8b64-41e7-8d53-c9687dc0391e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:10.557710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b1b7cf11-8b64-41e7-8d53-c9687dc0391e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:10.557710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b1b7cf11-8b64-41e7-8d53-c9687dc0391e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:10.557710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b1b7cf11-8b64-41e7-8d53-c9687dc0391e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:10.557710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b1b7cf11-8b64-41e7-8d53-c9687dc0391e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:10.558294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b1b7cf11-8b64-41e7-8d53-c9687dc0391e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:10.716283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b1b7cf11-8b64-41e7-8d53-c9687dc0391e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:10.724945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b1b7cf11-8b64-41e7-8d53-c9687dc0391e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.180059 Jun 17 07:41:10.726182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 332/652] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:10 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:10.968900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:10.969624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:10.975898 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:10.976347 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:10.977756 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:10.978150 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:11.115211 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:11.124391 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:11.125968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:11.127137 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9bcb6283-70a1-442b-b016-139e3d434f9b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.162623 Jun 17 07:41:11.127701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 321/653] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:10 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:11.744170 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1a2983d6-237a-4fb6-8edf-3b533c23c9d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:11.744769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1a2983d6-237a-4fb6-8edf-3b533c23c9d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:11.751284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1a2983d6-237a-4fb6-8edf-3b533c23c9d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:11.751727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1a2983d6-237a-4fb6-8edf-3b533c23c9d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:11.752484 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1a2983d6-237a-4fb6-8edf-3b533c23c9d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:11.752910 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1a2983d6-237a-4fb6-8edf-3b533c23c9d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:11.887749 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1a2983d6-237a-4fb6-8edf-3b533c23c9d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:11.896036 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1a2983d6-237a-4fb6-8edf-3b533c23c9d0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.156246 Jun 17 07:41:11.896629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 333/654] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:11 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:12.031861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-de1347e0-8b5e-450f-b7fb-4b1f6e423e35 req-ce6a903e-5870-4ddc-9b51-00fc5f0fb6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ad6743-cfda-46c3-afaa-6d54e2e80a2f", "name": "network-vif-plugged", "status": "completed", "tag": "1ce3a745-be88-4264-b1e5-51f76662590d"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:41:12.041513 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-de1347e0-8b5e-450f-b7fb-4b1f6e423e35 req-ce6a903e-5870-4ddc-9b51-00fc5f0fb6f9 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:12.041958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-de1347e0-8b5e-450f-b7fb-4b1f6e423e35 req-ce6a903e-5870-4ddc-9b51-00fc5f0fb6f9 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:12.053269 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-de1347e0-8b5e-450f-b7fb-4b1f6e423e35 req-ce6a903e-5870-4ddc-9b51-00fc5f0fb6f9 service nova] Creating event network-vif-plugged:1ce3a745-be88-4264-b1e5-51f76662590d for instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f on hv-cinder-79733 Jun 17 07:41:12.063841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-de1347e0-8b5e-450f-b7fb-4b1f6e423e35 req-ce6a903e-5870-4ddc-9b51-00fc5f0fb6f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031294 Jun 17 07:41:12.063841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 322/655] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:41:12.145597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:12.146202 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:12.152640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:12.153086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:12.153881 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:12.154313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:12.297197 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:12.306034 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:12.307523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:12.308684 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-22ff7533-29d4-4db1-b39f-20c6b95410fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.167174 Jun 17 07:41:12.309248 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 334/656] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:12 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:12.914420 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9f96f87c-5882-40a7-a5a0-fb19eecdbcb4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:12.915125 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9f96f87c-5882-40a7-a5a0-fb19eecdbcb4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:12.921553 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f96f87c-5882-40a7-a5a0-fb19eecdbcb4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:12.922009 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f96f87c-5882-40a7-a5a0-fb19eecdbcb4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:12.922888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f96f87c-5882-40a7-a5a0-fb19eecdbcb4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:12.923337 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f96f87c-5882-40a7-a5a0-fb19eecdbcb4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:13.059520 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9f96f87c-5882-40a7-a5a0-fb19eecdbcb4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:13.067716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9f96f87c-5882-40a7-a5a0-fb19eecdbcb4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.157447 Jun 17 07:41:13.068293 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 323/657] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:12 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:13.327615 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:13.328213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:13.334707 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:13.335146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:13.335906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:13.336335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:13.471163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:13.479650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:13.481121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:13.482302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2eb95ba1-a7f4-40f9-ab4b-3ca8dea3be77 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.158609 Jun 17 07:41:13.482864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 335/658] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:13 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:41:14.085218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3430f8bd-6e71-4d6c-b9b2-216bc8934314 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:14.085829 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3430f8bd-6e71-4d6c-b9b2-216bc8934314 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:14.088220 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=48 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:14.093022 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3430f8bd-6e71-4d6c-b9b2-216bc8934314 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:14.097570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3430f8bd-6e71-4d6c-b9b2-216bc8934314 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:14.097570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3430f8bd-6e71-4d6c-b9b2-216bc8934314 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:14.097570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3430f8bd-6e71-4d6c-b9b2-216bc8934314 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:14.240890 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3430f8bd-6e71-4d6c-b9b2-216bc8934314 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:14.249875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3430f8bd-6e71-4d6c-b9b2-216bc8934314 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.168487 Jun 17 07:41:14.250460 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 324/659] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:14 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:14.500956 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:14.501582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:14.508076 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:14.508540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:14.509290 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:14.509744 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:14.525030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:14.654467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:14.663789 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:14.666323 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:14.670047 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1f273013-4df8-4d88-93b0-1112a557d5ec tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.170514 Jun 17 07:41:14.671100 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 336/660] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:14 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:15.267575 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1a7dfc72-77cf-41fa-9a32-d1a9f1f40461 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:15.268615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1a7dfc72-77cf-41fa-9a32-d1a9f1f40461 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:15.276207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a7dfc72-77cf-41fa-9a32-d1a9f1f40461 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:15.276665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a7dfc72-77cf-41fa-9a32-d1a9f1f40461 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:15.277486 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a7dfc72-77cf-41fa-9a32-d1a9f1f40461 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:15.277929 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a7dfc72-77cf-41fa-9a32-d1a9f1f40461 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:15.415345 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1a7dfc72-77cf-41fa-9a32-d1a9f1f40461 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:15.417569 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:15.423793 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1a7dfc72-77cf-41fa-9a32-d1a9f1f40461 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.160075 Jun 17 07:41:15.424360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 325/661] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:15 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:15.690055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:15.690055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:15.696557 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:15.697007 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:15.697799 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:15.698235 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:15.831999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:15.840371 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:15.842017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:15.843160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fb5657dd-c151-4d1c-a7f1-55f05ca14d3c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1806 microversion: 2.20 time: 0.158368 Jun 17 07:41:15.843724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 337/662] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:15 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:41:16.441589 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fda11e34-bbdb-4347-b643-737bad0c0a92 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:16.442134 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fda11e34-bbdb-4347-b643-737bad0c0a92 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:16.449893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fda11e34-bbdb-4347-b643-737bad0c0a92 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:16.450336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fda11e34-bbdb-4347-b643-737bad0c0a92 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:16.451088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fda11e34-bbdb-4347-b643-737bad0c0a92 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:16.451527 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fda11e34-bbdb-4347-b643-737bad0c0a92 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:16.582630 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fda11e34-bbdb-4347-b643-737bad0c0a92 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:16.591628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fda11e34-bbdb-4347-b643-737bad0c0a92 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.153958 Jun 17 07:41:16.592217 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 326/663] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:16 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:16.861769 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:16.862730 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:16.870213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:16.870663 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:16.871458 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:16.871890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:17.003761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:17.012810 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:17.014337 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:17.015490 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a2eabdf7-9736-4f1d-81c9-7747c18f3365 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1793 microversion: 2.20 time: 0.157590 Jun 17 07:41:17.016051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 338/664] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:41:16 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1793 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:41:17.608834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-55a1fc9b-1b97-45aa-a458-9a3ac8f94693 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:17.609458 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-55a1fc9b-1b97-45aa-a458-9a3ac8f94693 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:17.616121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-55a1fc9b-1b97-45aa-a458-9a3ac8f94693 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:17.616564 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-55a1fc9b-1b97-45aa-a458-9a3ac8f94693 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:17.617532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-55a1fc9b-1b97-45aa-a458-9a3ac8f94693 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:17.618171 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-55a1fc9b-1b97-45aa-a458-9a3ac8f94693 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:17.746623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-55a1fc9b-1b97-45aa-a458-9a3ac8f94693 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:17.754609 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-55a1fc9b-1b97-45aa-a458-9a3ac8f94693 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.149610 Jun 17 07:41:17.755190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 327/665] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:17 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:18.771967 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5eb03edc-9ceb-4cb1-88a0-c108963bd477 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:18.772578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5eb03edc-9ceb-4cb1-88a0-c108963bd477 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:18.779306 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5eb03edc-9ceb-4cb1-88a0-c108963bd477 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:18.779752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5eb03edc-9ceb-4cb1-88a0-c108963bd477 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:18.780520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5eb03edc-9ceb-4cb1-88a0-c108963bd477 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:18.780944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5eb03edc-9ceb-4cb1-88a0-c108963bd477 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:18.910160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5eb03edc-9ceb-4cb1-88a0-c108963bd477 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:18.918759 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5eb03edc-9ceb-4cb1-88a0-c108963bd477 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.150691 Jun 17 07:41:18.919330 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 339/666] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:18 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:19.936833 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-436e6305-0dae-4c05-a549-7e7ed71b0145 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:19.943604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-436e6305-0dae-4c05-a549-7e7ed71b0145 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:19.943855 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-436e6305-0dae-4c05-a549-7e7ed71b0145 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:19.944301 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-436e6305-0dae-4c05-a549-7e7ed71b0145 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:19.945054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-436e6305-0dae-4c05-a549-7e7ed71b0145 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:19.946194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-436e6305-0dae-4c05-a549-7e7ed71b0145 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:20.075855 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-436e6305-0dae-4c05-a549-7e7ed71b0145 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:20.084169 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-436e6305-0dae-4c05-a549-7e7ed71b0145 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.151366 Jun 17 07:41:20.084741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 328/667] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:19 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:21.101250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6aa8e0cd-0a49-4ebf-875b-c7c4898e9abc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:21.102081 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6aa8e0cd-0a49-4ebf-875b-c7c4898e9abc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:21.104280 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=54 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:21.108954 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6aa8e0cd-0a49-4ebf-875b-c7c4898e9abc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:21.109427 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6aa8e0cd-0a49-4ebf-875b-c7c4898e9abc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:21.110179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6aa8e0cd-0a49-4ebf-875b-c7c4898e9abc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:21.110611 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6aa8e0cd-0a49-4ebf-875b-c7c4898e9abc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:21.245006 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6aa8e0cd-0a49-4ebf-875b-c7c4898e9abc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:21.253623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6aa8e0cd-0a49-4ebf-875b-c7c4898e9abc tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.156221 Jun 17 07:41:21.254195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 340/668] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:21 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:22.271618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e5862fee-fc5c-4504-af6a-5f09c30dbbdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:22.272227 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e5862fee-fc5c-4504-af6a-5f09c30dbbdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:22.279063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e5862fee-fc5c-4504-af6a-5f09c30dbbdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:22.279501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e5862fee-fc5c-4504-af6a-5f09c30dbbdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:22.280259 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e5862fee-fc5c-4504-af6a-5f09c30dbbdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:22.280715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e5862fee-fc5c-4504-af6a-5f09c30dbbdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:22.420362 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e5862fee-fc5c-4504-af6a-5f09c30dbbdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:22.428322 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e5862fee-fc5c-4504-af6a-5f09c30dbbdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.160550 Jun 17 07:41:22.430229 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 329/669] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:22 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:23.447025 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f8b3c441-951a-4407-95f7-006c97fa23af tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:23.447635 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f8b3c441-951a-4407-95f7-006c97fa23af tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:23.454406 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f8b3c441-951a-4407-95f7-006c97fa23af tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:23.454868 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f8b3c441-951a-4407-95f7-006c97fa23af tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:23.455699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f8b3c441-951a-4407-95f7-006c97fa23af tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:23.456154 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f8b3c441-951a-4407-95f7-006c97fa23af tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:23.591002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f8b3c441-951a-4407-95f7-006c97fa23af tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:23.600047 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f8b3c441-951a-4407-95f7-006c97fa23af tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.157430 Jun 17 07:41:23.601255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 341/670] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:23 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:24.617908 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ca4a85a1-c84e-4b1b-939d-f3a64d522ad5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:24.619636 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ca4a85a1-c84e-4b1b-939d-f3a64d522ad5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:24.625654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca4a85a1-c84e-4b1b-939d-f3a64d522ad5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:24.626100 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca4a85a1-c84e-4b1b-939d-f3a64d522ad5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:24.626869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca4a85a1-c84e-4b1b-939d-f3a64d522ad5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:24.627305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca4a85a1-c84e-4b1b-939d-f3a64d522ad5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:24.759676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ca4a85a1-c84e-4b1b-939d-f3a64d522ad5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:24.767746 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ca4a85a1-c84e-4b1b-939d-f3a64d522ad5 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.153732 Jun 17 07:41:24.768328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 330/671] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:24 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:25.785719 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-29a6543b-3f67-40ad-9e60-02c7da4c4fdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:25.786273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-29a6543b-3f67-40ad-9e60-02c7da4c4fdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:25.793496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-29a6543b-3f67-40ad-9e60-02c7da4c4fdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:25.793941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-29a6543b-3f67-40ad-9e60-02c7da4c4fdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:25.794699 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-29a6543b-3f67-40ad-9e60-02c7da4c4fdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:25.795132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-29a6543b-3f67-40ad-9e60-02c7da4c4fdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:25.927541 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-29a6543b-3f67-40ad-9e60-02c7da4c4fdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:25.939364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-29a6543b-3f67-40ad-9e60-02c7da4c4fdf tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.157149 Jun 17 07:41:25.939910 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 342/672] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:25 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:26.955887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-915b5ee5-34ef-41c9-b41d-b7a96ec8f2c0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:26.956499 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-915b5ee5-34ef-41c9-b41d-b7a96ec8f2c0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:26.963196 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-915b5ee5-34ef-41c9-b41d-b7a96ec8f2c0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:26.963650 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-915b5ee5-34ef-41c9-b41d-b7a96ec8f2c0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:26.964417 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-915b5ee5-34ef-41c9-b41d-b7a96ec8f2c0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:26.964886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-915b5ee5-34ef-41c9-b41d-b7a96ec8f2c0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:27.102767 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-915b5ee5-34ef-41c9-b41d-b7a96ec8f2c0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:27.111672 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-915b5ee5-34ef-41c9-b41d-b7a96ec8f2c0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.159566 Jun 17 07:41:27.112710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 331/673] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:26 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:28.130213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6fe680b4-b1f2-4b2a-8ac2-160cadd63d21 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:28.130811 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6fe680b4-b1f2-4b2a-8ac2-160cadd63d21 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:28.137466 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6fe680b4-b1f2-4b2a-8ac2-160cadd63d21 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:28.137904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6fe680b4-b1f2-4b2a-8ac2-160cadd63d21 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:28.138651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6fe680b4-b1f2-4b2a-8ac2-160cadd63d21 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:28.139084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6fe680b4-b1f2-4b2a-8ac2-160cadd63d21 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:28.271681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6fe680b4-b1f2-4b2a-8ac2-160cadd63d21 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:28.280436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6fe680b4-b1f2-4b2a-8ac2-160cadd63d21 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.154067 Jun 17 07:41:28.281009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 343/674] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:28 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:29.298248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a62c9876-7628-4dff-8982-82aed872e638 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:29.298841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a62c9876-7628-4dff-8982-82aed872e638 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:29.306011 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a62c9876-7628-4dff-8982-82aed872e638 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:29.306447 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a62c9876-7628-4dff-8982-82aed872e638 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:29.307198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a62c9876-7628-4dff-8982-82aed872e638 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:29.307626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a62c9876-7628-4dff-8982-82aed872e638 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:29.433679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a62c9876-7628-4dff-8982-82aed872e638 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:29.441529 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a62c9876-7628-4dff-8982-82aed872e638 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.147168 Jun 17 07:41:29.442087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 332/675] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:29 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:30.458467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4713bb77-8ffc-4a2d-87af-2b3a82f83688 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:30.459069 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4713bb77-8ffc-4a2d-87af-2b3a82f83688 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:30.465659 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4713bb77-8ffc-4a2d-87af-2b3a82f83688 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:30.466100 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4713bb77-8ffc-4a2d-87af-2b3a82f83688 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:30.466846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4713bb77-8ffc-4a2d-87af-2b3a82f83688 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:30.467273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4713bb77-8ffc-4a2d-87af-2b3a82f83688 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:30.600069 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4713bb77-8ffc-4a2d-87af-2b3a82f83688 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:30.608700 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4713bb77-8ffc-4a2d-87af-2b3a82f83688 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1736 microversion: 2.1 time: 0.153998 Jun 17 07:41:30.609278 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 344/676] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:30 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:30.836052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:41:30.836300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 07:41:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:41:31.627076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-35e1ddf8-f374-44e6-a3e6-5a3d6ad278a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:31.627737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-35e1ddf8-f374-44e6-a3e6-5a3d6ad278a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:31.634802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-35e1ddf8-f374-44e6-a3e6-5a3d6ad278a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:31.635261 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-35e1ddf8-f374-44e6-a3e6-5a3d6ad278a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:31.635990 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-35e1ddf8-f374-44e6-a3e6-5a3d6ad278a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:31.636421 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-35e1ddf8-f374-44e6-a3e6-5a3d6ad278a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:31.768470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-35e1ddf8-f374-44e6-a3e6-5a3d6ad278a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:31.776600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-35e1ddf8-f374-44e6-a3e6-5a3d6ad278a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1716 microversion: 2.1 time: 0.153322 Jun 17 07:41:31.777162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 333/677] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:31 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:31.831420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:31.831937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:31.838392 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:31.839039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:31.839799 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:31.840228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:31.921168 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] HTTP exception thrown: Cannot 'detach_volume' instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b while it is in vm_state rescued Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Request method failure captured: Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments/bcccb341-4a43-441c-98e2-f49bc99bbc8d HTTP/1.1 Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6HgW97DcVVe4zZ61jVJs6vqC6qVhgTTgpRZLuuUIvCMGWPsPvHURwju_GWPhbE2FTMvDkaV4jYSRQjzbnalfB7fA37jYPdA7b1XT9pj7nR03MzhEo5E5WEws7RJM_5lbiJWwsFyGl9Ass_D1fQkk_YzJmiXWio0Cd4ALAcqfvz0Hk Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:41:31.922837 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 8b753148f55e4fb0897bf9639e8d4d70 Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:41:31.924409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Cannot 'detach_volume' instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b while it is in vm_state rescued Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'server_id': 'c1866c92-f2f4-49e4-b391-ffca4b0ce35b', 'id': 'bcccb341-4a43-441c-98e2-f49bc99bbc8d'} Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:41:31.925227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b while it is in vm_state rescued Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b while it is in vm_state rescued Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:31.926539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Returning 409 to user: Cannot 'detach_volume' instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b while it is in vm_state rescued {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:41:31.927543 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-13b116ee-adfb-4dc1-9412-0d04a6aa2727 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments/bcccb341-4a43-441c-98e2-f49bc99bbc8d" status: 409 len: 152 microversion: 2.1 time: 0.096849 Jun 17 07:41:31.927543 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 345/678] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:41:31 2022] DELETE /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments/bcccb341-4a43-441c-98e2-f49bc99bbc8d => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 07:41:31.933669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-db6779ce-02f6-4055-9a15-59c1a67c42ab tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:41:31.934194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-db6779ce-02f6-4055-9a15-59c1a67c42ab tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:31.940037 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-db6779ce-02f6-4055-9a15-59c1a67c42ab tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:31.940481 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-db6779ce-02f6-4055-9a15-59c1a67c42ab tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:31.941228 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-db6779ce-02f6-4055-9a15-59c1a67c42ab tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:31.941699 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-db6779ce-02f6-4055-9a15-59c1a67c42ab tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:32.131082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-db6779ce-02f6-4055-9a15-59c1a67c42ab tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "POST /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/action" status: 202 len: 0 microversion: 2.1 time: 0.201503 Jun 17 07:41:32.131755 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 334/679] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:41:31 2022] POST /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:41:32.140494 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f346404d-4239-4021-8d29-6c9fb5d62d3b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:32.141165 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f346404d-4239-4021-8d29-6c9fb5d62d3b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:32.147214 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f346404d-4239-4021-8d29-6c9fb5d62d3b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:32.148552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f346404d-4239-4021-8d29-6c9fb5d62d3b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:32.149070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f346404d-4239-4021-8d29-6c9fb5d62d3b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:32.149593 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f346404d-4239-4021-8d29-6c9fb5d62d3b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:32.281387 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f346404d-4239-4021-8d29-6c9fb5d62d3b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:32.289468 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f346404d-4239-4021-8d29-6c9fb5d62d3b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1724 microversion: 2.1 time: 0.152718 Jun 17 07:41:32.290226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 346/680] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:32 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:41:33.308284 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7d3dc403-6bba-4cd3-8947-eccc92fa5cc0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:33.308981 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7d3dc403-6bba-4cd3-8947-eccc92fa5cc0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:33.315211 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7d3dc403-6bba-4cd3-8947-eccc92fa5cc0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:33.315650 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7d3dc403-6bba-4cd3-8947-eccc92fa5cc0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:33.316404 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7d3dc403-6bba-4cd3-8947-eccc92fa5cc0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:33.316835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7d3dc403-6bba-4cd3-8947-eccc92fa5cc0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:33.447177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7d3dc403-6bba-4cd3-8947-eccc92fa5cc0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:33.455105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7d3dc403-6bba-4cd3-8947-eccc92fa5cc0 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1724 microversion: 2.1 time: 0.151631 Jun 17 07:41:33.455676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 335/681] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:33 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:34.473247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b0416b4e-f2b5-4bb3-a685-38bc2003914a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:34.473827 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b0416b4e-f2b5-4bb3-a685-38bc2003914a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:34.480719 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b0416b4e-f2b5-4bb3-a685-38bc2003914a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:34.481159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b0416b4e-f2b5-4bb3-a685-38bc2003914a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:34.481948 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b0416b4e-f2b5-4bb3-a685-38bc2003914a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:34.482376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b0416b4e-f2b5-4bb3-a685-38bc2003914a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:34.614914 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b0416b4e-f2b5-4bb3-a685-38bc2003914a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:34.623696 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b0416b4e-f2b5-4bb3-a685-38bc2003914a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1724 microversion: 2.1 time: 0.154411 Jun 17 07:41:34.624264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 347/682] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:34 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:41:35.642113 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c0a8db09-0ac4-4205-82b1-4ad188f2a7a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:35.642693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c0a8db09-0ac4-4205-82b1-4ad188f2a7a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:35.649584 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c0a8db09-0ac4-4205-82b1-4ad188f2a7a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:35.650031 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c0a8db09-0ac4-4205-82b1-4ad188f2a7a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:35.650822 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c0a8db09-0ac4-4205-82b1-4ad188f2a7a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:35.651254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c0a8db09-0ac4-4205-82b1-4ad188f2a7a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:35.783552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c0a8db09-0ac4-4205-82b1-4ad188f2a7a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:35.791924 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c0a8db09-0ac4-4205-82b1-4ad188f2a7a9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1724 microversion: 2.1 time: 0.153780 Jun 17 07:41:35.792504 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 336/683] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:35 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:36.809833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fd84df02-daea-4177-aa39-eefe86f11571 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:36.810376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fd84df02-daea-4177-aa39-eefe86f11571 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:36.816912 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd84df02-daea-4177-aa39-eefe86f11571 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:36.817389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd84df02-daea-4177-aa39-eefe86f11571 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:36.818166 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd84df02-daea-4177-aa39-eefe86f11571 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:36.818603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd84df02-daea-4177-aa39-eefe86f11571 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:36.954553 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fd84df02-daea-4177-aa39-eefe86f11571 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:36.963155 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fd84df02-daea-4177-aa39-eefe86f11571 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1730 microversion: 2.1 time: 0.157316 Jun 17 07:41:36.963726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 348/684] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:36 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:41:36.980661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dd947337-acbf-4b7d-be12-84cd2a734f57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:36.981243 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dd947337-acbf-4b7d-be12-84cd2a734f57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:36.988092 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dd947337-acbf-4b7d-be12-84cd2a734f57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:36.988558 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dd947337-acbf-4b7d-be12-84cd2a734f57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:36.989359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dd947337-acbf-4b7d-be12-84cd2a734f57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:36.989783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dd947337-acbf-4b7d-be12-84cd2a734f57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:37.071050 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dd947337-acbf-4b7d-be12-84cd2a734f57 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094274 Jun 17 07:41:37.071656 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 337/685] 10.222.0.52 () {58 vars in 1274 bytes} [Fri Jun 17 07:41:36 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:41:38.079053 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-9238f76f-7fa6-4fc7-bad7-9b4353a6901b req-9d4bd8ae-68d9-4f99-a172-a48cce8020c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1866c92-f2f4-49e4-b391-ffca4b0ce35b", "tag": "1cbd5884-4ecf-4e5b-8a71-19880b70a371"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:41:38.088008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-9238f76f-7fa6-4fc7-bad7-9b4353a6901b req-9d4bd8ae-68d9-4f99-a172-a48cce8020c3 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:38.088764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-9238f76f-7fa6-4fc7-bad7-9b4353a6901b req-9d4bd8ae-68d9-4f99-a172-a48cce8020c3 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:38.100002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-9238f76f-7fa6-4fc7-bad7-9b4353a6901b req-9d4bd8ae-68d9-4f99-a172-a48cce8020c3 service nova] Creating event network-changed:1cbd5884-4ecf-4e5b-8a71-19880b70a371 for instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b on hv-cinder-79733 Jun 17 07:41:38.106310 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-9238f76f-7fa6-4fc7-bad7-9b4353a6901b req-9d4bd8ae-68d9-4f99-a172-a48cce8020c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100818 Jun 17 07:41:38.106821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 349/686] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:41:40.121711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-27b96bc9-363e-4d88-bb60-5210fc35d2fe req-db0cdf2d-fd38-48ca-b387-74a97c3f797c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1866c92-f2f4-49e4-b391-ffca4b0ce35b", "tag": "1cbd5884-4ecf-4e5b-8a71-19880b70a371"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:41:40.129795 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-27b96bc9-363e-4d88-bb60-5210fc35d2fe req-db0cdf2d-fd38-48ca-b387-74a97c3f797c service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:40.130241 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-27b96bc9-363e-4d88-bb60-5210fc35d2fe req-db0cdf2d-fd38-48ca-b387-74a97c3f797c service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:40.141707 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-27b96bc9-363e-4d88-bb60-5210fc35d2fe req-db0cdf2d-fd38-48ca-b387-74a97c3f797c service nova] Creating event network-changed:1cbd5884-4ecf-4e5b-8a71-19880b70a371 for instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b on hv-cinder-79733 Jun 17 07:41:40.147005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-27b96bc9-363e-4d88-bb60-5210fc35d2fe req-db0cdf2d-fd38-48ca-b387-74a97c3f797c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029421 Jun 17 07:41:40.148156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 338/687] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:41:54.778312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=19 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:54.779091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=77 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:54.883831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2a11f920-fb73-42eb-b9ae-ef7f692b1ef1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:54.884685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2a11f920-fb73-42eb-b9ae-ef7f692b1ef1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:54.891026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a11f920-fb73-42eb-b9ae-ef7f692b1ef1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:54.891472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a11f920-fb73-42eb-b9ae-ef7f692b1ef1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:54.892236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a11f920-fb73-42eb-b9ae-ef7f692b1ef1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:54.892668 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a11f920-fb73-42eb-b9ae-ef7f692b1ef1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:54.919275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2a11f920-fb73-42eb-b9ae-ef7f692b1ef1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Going to try to terminate instance {{(pid=124472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:41:55.252562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2a11f920-fb73-42eb-b9ae-ef7f692b1ef1 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 204 len: 0 microversion: 2.1 time: 0.475672 Jun 17 07:41:55.253184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 350/688] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:41:54 2022] DELETE /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:41:55.262398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d432ebf7-f5f0-442d-8737-e0dd47c88559 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:55.263093 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d432ebf7-f5f0-442d-8737-e0dd47c88559 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:55.265740 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=29 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:55.266377 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:41:55.271296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d432ebf7-f5f0-442d-8737-e0dd47c88559 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:55.271739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d432ebf7-f5f0-442d-8737-e0dd47c88559 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:55.272494 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d432ebf7-f5f0-442d-8737-e0dd47c88559 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:55.272954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d432ebf7-f5f0-442d-8737-e0dd47c88559 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:55.417307 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d432ebf7-f5f0-442d-8737-e0dd47c88559 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:55.425095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d432ebf7-f5f0-442d-8737-e0dd47c88559 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1576 microversion: 2.1 time: 0.167378 Jun 17 07:41:55.425704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 339/689] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:55 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:56.444396 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-11f74e50-81f4-4684-9646-e2b38a7bac79 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:56.444997 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-11f74e50-81f4-4684-9646-e2b38a7bac79 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:56.452165 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-11f74e50-81f4-4684-9646-e2b38a7bac79 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:56.452610 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-11f74e50-81f4-4684-9646-e2b38a7bac79 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:56.453398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-11f74e50-81f4-4684-9646-e2b38a7bac79 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:56.453835 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-11f74e50-81f4-4684-9646-e2b38a7bac79 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:56.599817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-11f74e50-81f4-4684-9646-e2b38a7bac79 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:56.607804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-11f74e50-81f4-4684-9646-e2b38a7bac79 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1576 microversion: 2.1 time: 0.167653 Jun 17 07:41:56.608377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 351/690] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:56 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:57.626822 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-82a4c581-ab85-4ef6-9c0d-46d8d9af926f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:57.627423 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-82a4c581-ab85-4ef6-9c0d-46d8d9af926f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:57.639121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-82a4c581-ab85-4ef6-9c0d-46d8d9af926f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:57.639569 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-82a4c581-ab85-4ef6-9c0d-46d8d9af926f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:57.640352 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-82a4c581-ab85-4ef6-9c0d-46d8d9af926f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:57.640846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-82a4c581-ab85-4ef6-9c0d-46d8d9af926f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:57.788843 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-82a4c581-ab85-4ef6-9c0d-46d8d9af926f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:57.797039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-82a4c581-ab85-4ef6-9c0d-46d8d9af926f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1576 microversion: 2.1 time: 0.174468 Jun 17 07:41:57.797642 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 340/691] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:57 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:58.471656 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-861b003e-3759-4868-8ffa-69c665e667c1 req-33658937-3e80-407d-acf4-278c890da657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b922b8-4ba9-41d6-88a1-93b33e926c3d", "name": "network-vif-deleted", "tag": "60118ee3-55e2-4a60-a28d-85637e355647"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:41:58.480548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-861b003e-3759-4868-8ffa-69c665e667c1 req-33658937-3e80-407d-acf4-278c890da657 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:58.480989 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-861b003e-3759-4868-8ffa-69c665e667c1 req-33658937-3e80-407d-acf4-278c890da657 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:58.494827 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-861b003e-3759-4868-8ffa-69c665e667c1 req-33658937-3e80-407d-acf4-278c890da657 service nova] Creating event network-vif-deleted:60118ee3-55e2-4a60-a28d-85637e355647 for instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d on hv-cinder-79733 Jun 17 07:41:58.500408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-861b003e-3759-4868-8ffa-69c665e667c1 req-33658937-3e80-407d-acf4-278c890da657 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102951 Jun 17 07:41:58.501639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 352/692] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:41:58.815931 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-223d161a-113a-4d8d-8830-08fe8bdc8a0f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:58.816599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-223d161a-113a-4d8d-8830-08fe8bdc8a0f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:58.823687 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-223d161a-113a-4d8d-8830-08fe8bdc8a0f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:58.824136 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-223d161a-113a-4d8d-8830-08fe8bdc8a0f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:58.824898 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-223d161a-113a-4d8d-8830-08fe8bdc8a0f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:58.825350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-223d161a-113a-4d8d-8830-08fe8bdc8a0f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:58.895116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-223d161a-113a-4d8d-8830-08fe8bdc8a0f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:41:58.906594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-223d161a-113a-4d8d-8830-08fe8bdc8a0f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 200 len: 1225 microversion: 2.1 time: 0.094293 Jun 17 07:41:58.907194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 341/693] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:58 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:41:59.927058 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:41:59.927822 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:41:59.934935 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:59.935394 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:59.936163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:41:59.936604 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:41:59.950828 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] HTTP exception thrown: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Request method failure captured: Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d HTTP/1.1 Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC7x1QV1pE2P0BTf8OF0T_YdHUGtLLNceXrrMgElDZxlxw8JOO5LlVfgKGqwJ4vTkDYv6OivZjZpwEzFpE0wZyt3BzumlPTb7UIJnyGAmDMjSRU5uJy57oSeIy-nLDWnoBVf6euifGAHqEVzjARmpwC2PMcyALEH03UxUBgrm7hoROY Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:41:59.952478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 781e29f49f27417a96cfc4ba00af95dd Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:41:59.954213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'd5b922b8-4ba9-41d6-88a1-93b33e926c3d'} Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:41:59.963679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:41:59.964937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:41:59.966726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Returning 404 to user: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:41:59.966726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1315872b-b3b5-4b13-89f1-b9bd7890e4d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 404 len: 111 microversion: 2.1 time: 0.031211 Jun 17 07:41:59.966726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 353/694] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:41:59 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:42:00.001991 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1753882504", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1192281260", "security_groups": [{"name": "tempest-secgroup-smoke-962214724"}], "block_device_mapping_v2": [{"uuid": "33e53cfc-bc2a-4639-b5e1-73b799458ac7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "156b13e9-64a4-4462-8a1a-126909d8e3f9"}]}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:00.116708 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] validate_networks() for [('156b13e9-64a4-4462-8a1a-126909d8e3f9', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:42:00.537532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:42:00.537952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:42:00.538421 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:42:00.538824 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:42:00.539833 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:42:00.548676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:00.549114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:00.549945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:00.550377 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:00.567405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Getting quotas for project 8705999014cf43e1b1ccd5186b67b4bd. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:42:00.572713 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Getting quotas for user 781e29f49f27417a96cfc4ba00af95dd and project 8705999014cf43e1b1ccd5186b67b4bd. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:42:00.629175 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:42:00.631333 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33e53cfc-bc2a-4639-b5e1-73b799458ac7',volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:42:00.976851 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f57e3fc6-d741-4ebb-b8bc-46396e4205b9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.979485 Jun 17 07:42:00.977502 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 342/695] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:41:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:42:00.989203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6903767f-cdec-475f-997f-7ce023169904 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:00.989848 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6903767f-cdec-475f-997f-7ce023169904 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:01.050622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6903767f-cdec-475f-997f-7ce023169904 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:01.057361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6903767f-cdec-475f-997f-7ce023169904 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1095 microversion: 2.1 time: 0.072069 Jun 17 07:42:01.057927 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 354/696] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:00 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:02.074934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a034c50c-7753-419f-bb21-551a93587cee tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:02.075552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a034c50c-7753-419f-bb21-551a93587cee tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:02.081700 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a034c50c-7753-419f-bb21-551a93587cee tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:02.082118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a034c50c-7753-419f-bb21-551a93587cee tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:02.082876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a034c50c-7753-419f-bb21-551a93587cee tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:02.083313 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a034c50c-7753-419f-bb21-551a93587cee tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:02.149359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a034c50c-7753-419f-bb21-551a93587cee tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:02.157455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a034c50c-7753-419f-bb21-551a93587cee tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1145 microversion: 2.1 time: 0.087392 Jun 17 07:42:02.158058 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 343/697] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:02 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:03.174810 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1f6cf1b6-5062-47e8-98a1-bb14f69936a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:03.175504 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1f6cf1b6-5062-47e8-98a1-bb14f69936a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:03.183378 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6cf1b6-5062-47e8-98a1-bb14f69936a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:03.183828 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6cf1b6-5062-47e8-98a1-bb14f69936a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:03.184594 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6cf1b6-5062-47e8-98a1-bb14f69936a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:03.185059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6cf1b6-5062-47e8-98a1-bb14f69936a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:03.259256 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1f6cf1b6-5062-47e8-98a1-bb14f69936a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:03.267754 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1f6cf1b6-5062-47e8-98a1-bb14f69936a9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1211 microversion: 2.1 time: 0.096707 Jun 17 07:42:03.268319 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 355/698] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:03 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:04.285704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-61e2ad51-3c4f-49af-a456-d8f7b419419c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:04.286308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-61e2ad51-3c4f-49af-a456-d8f7b419419c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:04.292964 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-61e2ad51-3c4f-49af-a456-d8f7b419419c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:04.293450 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-61e2ad51-3c4f-49af-a456-d8f7b419419c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:04.294207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-61e2ad51-3c4f-49af-a456-d8f7b419419c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:04.294635 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-61e2ad51-3c4f-49af-a456-d8f7b419419c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:04.691910 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-61e2ad51-3c4f-49af-a456-d8f7b419419c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:04.706031 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-61e2ad51-3c4f-49af-a456-d8f7b419419c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1278 microversion: 2.1 time: 0.423693 Jun 17 07:42:04.706729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 344/699] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:04 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1278 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:04.710510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-835b1d4f-4ce8-4b59-a0ce-50ecab890cc7 req-1ced5bda-59f7-418f-9d7e-cc857bcdb057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09674923-6d3d-4ad8-a777-4f1bfdeb77fc", "tag": "22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:04.721433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-835b1d4f-4ce8-4b59-a0ce-50ecab890cc7 req-1ced5bda-59f7-418f-9d7e-cc857bcdb057 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:04.722918 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-835b1d4f-4ce8-4b59-a0ce-50ecab890cc7 req-1ced5bda-59f7-418f-9d7e-cc857bcdb057 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:04.734708 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-835b1d4f-4ce8-4b59-a0ce-50ecab890cc7 req-1ced5bda-59f7-418f-9d7e-cc857bcdb057 service nova] Creating event network-changed:22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7 for instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc on hv-cinder-79733 Jun 17 07:42:04.740044 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-835b1d4f-4ce8-4b59-a0ce-50ecab890cc7 req-1ced5bda-59f7-418f-9d7e-cc857bcdb057 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033186 Jun 17 07:42:04.740820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 356/700] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:42:05.723873 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5ecb1861-45c9-46e2-8d22-e445129ad5bf tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:05.724485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5ecb1861-45c9-46e2-8d22-e445129ad5bf tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:05.731707 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5ecb1861-45c9-46e2-8d22-e445129ad5bf tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:05.732163 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5ecb1861-45c9-46e2-8d22-e445129ad5bf tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:05.732934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5ecb1861-45c9-46e2-8d22-e445129ad5bf tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:05.733399 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5ecb1861-45c9-46e2-8d22-e445129ad5bf tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:05.864062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5ecb1861-45c9-46e2-8d22-e445129ad5bf tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:05.872627 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5ecb1861-45c9-46e2-8d22-e445129ad5bf tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.152787 Jun 17 07:42:05.873201 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 345/701] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:05 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:06.890870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7b3e9ce8-5267-4955-88e3-42fb70015bec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:06.897565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7b3e9ce8-5267-4955-88e3-42fb70015bec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:06.897847 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b3e9ce8-5267-4955-88e3-42fb70015bec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:06.898895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b3e9ce8-5267-4955-88e3-42fb70015bec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:06.899756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b3e9ce8-5267-4955-88e3-42fb70015bec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:06.900189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7b3e9ce8-5267-4955-88e3-42fb70015bec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:07.044821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7b3e9ce8-5267-4955-88e3-42fb70015bec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:07.052422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7b3e9ce8-5267-4955-88e3-42fb70015bec tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.166333 Jun 17 07:42:07.052993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 357/702] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:06 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:08.071283 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-16616598-26a7-41ea-a760-0a3d5fd7a641 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:08.072106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-16616598-26a7-41ea-a760-0a3d5fd7a641 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:08.078437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-16616598-26a7-41ea-a760-0a3d5fd7a641 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:08.078889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-16616598-26a7-41ea-a760-0a3d5fd7a641 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:08.079658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-16616598-26a7-41ea-a760-0a3d5fd7a641 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:08.080095 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-16616598-26a7-41ea-a760-0a3d5fd7a641 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:08.240618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-16616598-26a7-41ea-a760-0a3d5fd7a641 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:08.249251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-16616598-26a7-41ea-a760-0a3d5fd7a641 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.182624 Jun 17 07:42:08.249869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 346/703] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:08 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:09.266783 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c8e85ae9-390b-4952-88d6-4312b6c5994a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:09.267377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c8e85ae9-390b-4952-88d6-4312b6c5994a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:09.274376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c8e85ae9-390b-4952-88d6-4312b6c5994a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:09.274810 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c8e85ae9-390b-4952-88d6-4312b6c5994a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:09.275569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c8e85ae9-390b-4952-88d6-4312b6c5994a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:09.275992 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c8e85ae9-390b-4952-88d6-4312b6c5994a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:09.407770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c8e85ae9-390b-4952-88d6-4312b6c5994a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:09.415822 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c8e85ae9-390b-4952-88d6-4312b6c5994a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.152834 Jun 17 07:42:09.416393 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 358/704] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:09 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:10.432614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ac0a33d7-91c6-4ae6-9129-b61b60a0da25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:10.433223 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ac0a33d7-91c6-4ae6-9129-b61b60a0da25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:10.439814 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ac0a33d7-91c6-4ae6-9129-b61b60a0da25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:10.440259 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ac0a33d7-91c6-4ae6-9129-b61b60a0da25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:10.441009 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ac0a33d7-91c6-4ae6-9129-b61b60a0da25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:10.441473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ac0a33d7-91c6-4ae6-9129-b61b60a0da25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:10.557873 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:10.570248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ac0a33d7-91c6-4ae6-9129-b61b60a0da25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:10.577932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ac0a33d7-91c6-4ae6-9129-b61b60a0da25 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.149689 Jun 17 07:42:10.578729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 347/705] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:10 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:11.489565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:11.589943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-551d6dec-10e4-4ee2-883b-33278c1ccd2f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:11.590434 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-551d6dec-10e4-4ee2-883b-33278c1ccd2f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:11.595385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f30ab4f2-50b8-4dbf-bd48-7bfa8805d8b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:11.595994 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f30ab4f2-50b8-4dbf-bd48-7bfa8805d8b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:11.596672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-551d6dec-10e4-4ee2-883b-33278c1ccd2f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:11.597122 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-551d6dec-10e4-4ee2-883b-33278c1ccd2f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:11.597796 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=6 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:11.607051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-551d6dec-10e4-4ee2-883b-33278c1ccd2f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:11.607051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-551d6dec-10e4-4ee2-883b-33278c1ccd2f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:11.607297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f30ab4f2-50b8-4dbf-bd48-7bfa8805d8b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:11.607297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f30ab4f2-50b8-4dbf-bd48-7bfa8805d8b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:11.607297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f30ab4f2-50b8-4dbf-bd48-7bfa8805d8b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:11.607297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f30ab4f2-50b8-4dbf-bd48-7bfa8805d8b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:11.691696 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-551d6dec-10e4-4ee2-883b-33278c1ccd2f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lazy-loading 'services' on Instance uuid 8444090b-ae6f-4602-a407-fbc601de5625 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:42:11.750834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f30ab4f2-50b8-4dbf-bd48-7bfa8805d8b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:11.759716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f30ab4f2-50b8-4dbf-bd48-7bfa8805d8b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.168710 Jun 17 07:42:11.762419 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 348/706] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:11 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:11.883128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-551d6dec-10e4-4ee2-883b-33278c1ccd2f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/os-volume_attachments/8c19dce6-c718-400a-a07c-2cbb7dde0d31" status: 202 len: 0 microversion: 2.1 time: 0.398319 Jun 17 07:42:11.883921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 359/707] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:42:11 2022] DELETE /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/os-volume_attachments/8c19dce6-c718-400a-a07c-2cbb7dde0d31 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:42:12.777251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9a838707-0c71-46c1-97cb-685aea2ada75 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:12.777864 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9a838707-0c71-46c1-97cb-685aea2ada75 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:12.784270 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a838707-0c71-46c1-97cb-685aea2ada75 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:12.784711 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a838707-0c71-46c1-97cb-685aea2ada75 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:12.785493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a838707-0c71-46c1-97cb-685aea2ada75 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:12.785921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9a838707-0c71-46c1-97cb-685aea2ada75 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:12.916683 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9a838707-0c71-46c1-97cb-685aea2ada75 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:12.924069 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9a838707-0c71-46c1-97cb-685aea2ada75 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.151255 Jun 17 07:42:12.924634 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 349/708] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:12 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:13.942605 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0c3bd07b-4a14-4b71-aa37-c7422f3a386b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:13.943224 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0c3bd07b-4a14-4b71-aa37-c7422f3a386b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:13.950839 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c3bd07b-4a14-4b71-aa37-c7422f3a386b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:13.951283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c3bd07b-4a14-4b71-aa37-c7422f3a386b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:13.952055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c3bd07b-4a14-4b71-aa37-c7422f3a386b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:13.952485 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0c3bd07b-4a14-4b71-aa37-c7422f3a386b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:14.086063 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0c3bd07b-4a14-4b71-aa37-c7422f3a386b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:14.093687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0c3bd07b-4a14-4b71-aa37-c7422f3a386b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.155958 Jun 17 07:42:14.094262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 360/709] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:13 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:15.112734 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0d4a178f-882a-4404-a479-be735b2d03af tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:15.113312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3187cb2f-b9fd-445f-9af0-5ff1043d896b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:15.113728 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0d4a178f-882a-4404-a479-be735b2d03af tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:15.120061 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3187cb2f-b9fd-445f-9af0-5ff1043d896b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:15.120286 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d4a178f-882a-4404-a479-be735b2d03af tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:15.120515 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d4a178f-882a-4404-a479-be735b2d03af tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:15.120631 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3187cb2f-b9fd-445f-9af0-5ff1043d896b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:15.122406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d4a178f-882a-4404-a479-be735b2d03af tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:15.122853 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d4a178f-882a-4404-a479-be735b2d03af tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:15.144326 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3187cb2f-b9fd-445f-9af0-5ff1043d896b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Going to try to stop instance {{(pid=124472) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 07:42:15.262335 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0d4a178f-882a-4404-a479-be735b2d03af tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:15.269959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0d4a178f-882a-4404-a479-be735b2d03af tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.161201 Jun 17 07:42:15.270532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 350/710] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:15 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:15.363974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3187cb2f-b9fd-445f-9af0-5ff1043d896b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/action" status: 202 len: 0 microversion: 2.1 time: 0.254982 Jun 17 07:42:15.365302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 361/711] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:42:15 2022] POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:42:15.374787 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-afb02bce-f037-4242-af6c-e79a5750a367 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:15.375393 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-afb02bce-f037-4242-af6c-e79a5750a367 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:15.381296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-afb02bce-f037-4242-af6c-e79a5750a367 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:15.381771 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-afb02bce-f037-4242-af6c-e79a5750a367 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:15.383217 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-afb02bce-f037-4242-af6c-e79a5750a367 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:15.383644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-afb02bce-f037-4242-af6c-e79a5750a367 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:15.516655 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-afb02bce-f037-4242-af6c-e79a5750a367 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:15.524153 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-afb02bce-f037-4242-af6c-e79a5750a367 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.153241 Jun 17 07:42:15.524721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 351/712] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:15 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:15.813406 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-abe27ad9-95a8-4d76-b90c-8bdb35641747 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:15.813930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-abe27ad9-95a8-4d76-b90c-8bdb35641747 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:15.820698 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-abe27ad9-95a8-4d76-b90c-8bdb35641747 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:15.821079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-abe27ad9-95a8-4d76-b90c-8bdb35641747 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:15.821861 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-abe27ad9-95a8-4d76-b90c-8bdb35641747 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:15.822288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-abe27ad9-95a8-4d76-b90c-8bdb35641747 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:15.844447 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-abe27ad9-95a8-4d76-b90c-8bdb35641747 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lazy-loading 'flavor' on Instance uuid d0a5406c-f3f3-41ee-b763-cfcabfa91915 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:42:16.087016 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-abe27ad9-95a8-4d76-b90c-8bdb35641747 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "POST /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915/action" status: 202 len: 0 microversion: 2.1 time: 0.277702 Jun 17 07:42:16.087596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 362/713] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:42:15 2022] POST /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:42:16.096027 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2052d2ad-2d24-4c5e-b492-fab14a843ba3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:16.096644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2052d2ad-2d24-4c5e-b492-fab14a843ba3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:16.103737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2052d2ad-2d24-4c5e-b492-fab14a843ba3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:16.107198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2052d2ad-2d24-4c5e-b492-fab14a843ba3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:16.107198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2052d2ad-2d24-4c5e-b492-fab14a843ba3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:16.107198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2052d2ad-2d24-4c5e-b492-fab14a843ba3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:16.238343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2052d2ad-2d24-4c5e-b492-fab14a843ba3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:16.245923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2052d2ad-2d24-4c5e-b492-fab14a843ba3 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.153903 Jun 17 07:42:16.246487 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 352/714] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:16 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:16.287150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4f430e05-a587-4722-a3e5-ecf6d11a1a88 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:16.287923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4f430e05-a587-4722-a3e5-ecf6d11a1a88 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:16.294757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4f430e05-a587-4722-a3e5-ecf6d11a1a88 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:16.295273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4f430e05-a587-4722-a3e5-ecf6d11a1a88 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:16.296128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4f430e05-a587-4722-a3e5-ecf6d11a1a88 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:16.296558 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4f430e05-a587-4722-a3e5-ecf6d11a1a88 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:16.436961 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4f430e05-a587-4722-a3e5-ecf6d11a1a88 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:16.444721 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4f430e05-a587-4722-a3e5-ecf6d11a1a88 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.162071 Jun 17 07:42:16.445781 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 363/715] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:16 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:16.520397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-511b61e0-da62-4188-a59c-3b82c85146d2 req-5c139ca0-1aca-48c5-85b2-626b9d35fb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09674923-6d3d-4ad8-a777-4f1bfdeb77fc", "name": "network-vif-plugged", "status": "completed", "tag": "22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:16.529411 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-511b61e0-da62-4188-a59c-3b82c85146d2 req-5c139ca0-1aca-48c5-85b2-626b9d35fb34 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:16.529861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-511b61e0-da62-4188-a59c-3b82c85146d2 req-5c139ca0-1aca-48c5-85b2-626b9d35fb34 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:16.541340 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-511b61e0-da62-4188-a59c-3b82c85146d2 req-5c139ca0-1aca-48c5-85b2-626b9d35fb34 service nova] Creating event network-vif-plugged:22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7 for instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc on hv-cinder-79733 Jun 17 07:42:16.543208 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-569be19b-9c56-4f89-9f1a-b09e3a1ec112 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:16.543816 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-569be19b-9c56-4f89-9f1a-b09e3a1ec112 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:16.546328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-511b61e0-da62-4188-a59c-3b82c85146d2 req-5c139ca0-1aca-48c5-85b2-626b9d35fb34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029610 Jun 17 07:42:16.547166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 353/716] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:42:16.551245 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-569be19b-9c56-4f89-9f1a-b09e3a1ec112 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:16.551695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-569be19b-9c56-4f89-9f1a-b09e3a1ec112 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:16.552533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-569be19b-9c56-4f89-9f1a-b09e3a1ec112 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:16.553021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-569be19b-9c56-4f89-9f1a-b09e3a1ec112 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:16.557865 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:16.692892 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-569be19b-9c56-4f89-9f1a-b09e3a1ec112 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:16.700885 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-569be19b-9c56-4f89-9f1a-b09e3a1ec112 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.162881 Jun 17 07:42:16.701481 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 364/717] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:16 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:17.265051 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ea5d1871-e8b1-442f-aab0-526fd899b50d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:17.265777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ea5d1871-e8b1-442f-aab0-526fd899b50d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:17.271939 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ea5d1871-e8b1-442f-aab0-526fd899b50d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:17.272381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ea5d1871-e8b1-442f-aab0-526fd899b50d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:17.273827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ea5d1871-e8b1-442f-aab0-526fd899b50d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:17.274263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ea5d1871-e8b1-442f-aab0-526fd899b50d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:17.408707 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ea5d1871-e8b1-442f-aab0-526fd899b50d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:17.416301 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ea5d1871-e8b1-442f-aab0-526fd899b50d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.155892 Jun 17 07:42:17.417383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 354/718] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:17 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:17.461217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3baa028e-b52f-44ec-8865-17b356b15a8d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:17.461860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3baa028e-b52f-44ec-8865-17b356b15a8d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:17.468315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3baa028e-b52f-44ec-8865-17b356b15a8d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:17.468760 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3baa028e-b52f-44ec-8865-17b356b15a8d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:17.469560 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3baa028e-b52f-44ec-8865-17b356b15a8d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:17.469995 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3baa028e-b52f-44ec-8865-17b356b15a8d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:17.604311 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3baa028e-b52f-44ec-8865-17b356b15a8d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:17.612140 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3baa028e-b52f-44ec-8865-17b356b15a8d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.154750 Jun 17 07:42:17.612646 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 365/719] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:17 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:17.718306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-894e61b7-c49c-4203-9cd8-8e9f99ec4b55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:17.718946 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-894e61b7-c49c-4203-9cd8-8e9f99ec4b55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:17.724968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-894e61b7-c49c-4203-9cd8-8e9f99ec4b55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:17.725452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-894e61b7-c49c-4203-9cd8-8e9f99ec4b55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:17.726310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-894e61b7-c49c-4203-9cd8-8e9f99ec4b55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:17.726746 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-894e61b7-c49c-4203-9cd8-8e9f99ec4b55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:17.856112 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-894e61b7-c49c-4203-9cd8-8e9f99ec4b55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:17.863850 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-894e61b7-c49c-4203-9cd8-8e9f99ec4b55 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.149393 Jun 17 07:42:17.864360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 355/720] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:17 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:18.434166 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-907af00c-bd40-41c7-a1c2-a53cf9dbddab tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:18.434693 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-907af00c-bd40-41c7-a1c2-a53cf9dbddab tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:18.440824 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-907af00c-bd40-41c7-a1c2-a53cf9dbddab tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:18.441274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-907af00c-bd40-41c7-a1c2-a53cf9dbddab tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:18.442078 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-907af00c-bd40-41c7-a1c2-a53cf9dbddab tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:18.442509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-907af00c-bd40-41c7-a1c2-a53cf9dbddab tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:18.580718 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-907af00c-bd40-41c7-a1c2-a53cf9dbddab tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:18.589595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-907af00c-bd40-41c7-a1c2-a53cf9dbddab tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.159266 Jun 17 07:42:18.590172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 366/721] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:18 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:18.629221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-404a754f-a2a3-4d2f-8b05-7c0b9aa93d9e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:18.629862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-404a754f-a2a3-4d2f-8b05-7c0b9aa93d9e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:18.637229 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-404a754f-a2a3-4d2f-8b05-7c0b9aa93d9e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:18.637719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-404a754f-a2a3-4d2f-8b05-7c0b9aa93d9e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:18.638485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-404a754f-a2a3-4d2f-8b05-7c0b9aa93d9e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:18.638924 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-404a754f-a2a3-4d2f-8b05-7c0b9aa93d9e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:18.789166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-404a754f-a2a3-4d2f-8b05-7c0b9aa93d9e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:18.794463 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:18.799312 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-404a754f-a2a3-4d2f-8b05-7c0b9aa93d9e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1266 microversion: 2.1 time: 0.173927 Jun 17 07:42:18.799951 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 356/722] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:18 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:18.882058 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5fc99675-dcdc-4656-a6c1-2c2dd140ffe4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:18.882672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5fc99675-dcdc-4656-a6c1-2c2dd140ffe4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:18.888805 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5fc99675-dcdc-4656-a6c1-2c2dd140ffe4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:18.889246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5fc99675-dcdc-4656-a6c1-2c2dd140ffe4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:18.890024 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5fc99675-dcdc-4656-a6c1-2c2dd140ffe4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:18.890449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5fc99675-dcdc-4656-a6c1-2c2dd140ffe4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:19.026277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5fc99675-dcdc-4656-a6c1-2c2dd140ffe4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:19.033733 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5fc99675-dcdc-4656-a6c1-2c2dd140ffe4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.155948 Jun 17 07:42:19.034324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 367/723] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:18 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:19.607640 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c543277b-9e9c-4c98-9831-cd33a8282595 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:19.608248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c543277b-9e9c-4c98-9831-cd33a8282595 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:19.615039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c543277b-9e9c-4c98-9831-cd33a8282595 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:19.615487 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c543277b-9e9c-4c98-9831-cd33a8282595 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:19.616247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c543277b-9e9c-4c98-9831-cd33a8282595 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:19.617292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c543277b-9e9c-4c98-9831-cd33a8282595 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:19.754530 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c543277b-9e9c-4c98-9831-cd33a8282595 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:19.763206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c543277b-9e9c-4c98-9831-cd33a8282595 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.159309 Jun 17 07:42:19.763802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 357/724] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:19 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:19.817084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3a62f4ac-e9b7-4e58-ad05-03c2bcec5542 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:19.817814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3a62f4ac-e9b7-4e58-ad05-03c2bcec5542 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:19.825576 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3a62f4ac-e9b7-4e58-ad05-03c2bcec5542 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:19.826032 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3a62f4ac-e9b7-4e58-ad05-03c2bcec5542 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:19.826804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3a62f4ac-e9b7-4e58-ad05-03c2bcec5542 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:19.827275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3a62f4ac-e9b7-4e58-ad05-03c2bcec5542 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:19.959449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3a62f4ac-e9b7-4e58-ad05-03c2bcec5542 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:19.966976 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3a62f4ac-e9b7-4e58-ad05-03c2bcec5542 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1452 microversion: 2.1 time: 0.153778 Jun 17 07:42:19.967544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 368/725] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:19 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:19.982673 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-66f44dc0-d4af-4acf-ba39-c39cf8cc9b19 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:19.983284 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-66f44dc0-d4af-4acf-ba39-c39cf8cc9b19 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:19.989561 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-66f44dc0-d4af-4acf-ba39-c39cf8cc9b19 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:19.990010 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-66f44dc0-d4af-4acf-ba39-c39cf8cc9b19 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:19.990765 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-66f44dc0-d4af-4acf-ba39-c39cf8cc9b19 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:19.991203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-66f44dc0-d4af-4acf-ba39-c39cf8cc9b19 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:20.051131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7322b89e-a564-4270-8e84-5f9c134d33db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:20.051852 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7322b89e-a564-4270-8e84-5f9c134d33db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:20.058562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7322b89e-a564-4270-8e84-5f9c134d33db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:20.059015 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7322b89e-a564-4270-8e84-5f9c134d33db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:20.059820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7322b89e-a564-4270-8e84-5f9c134d33db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:20.060253 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7322b89e-a564-4270-8e84-5f9c134d33db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:20.127892 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-66f44dc0-d4af-4acf-ba39-c39cf8cc9b19 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:20.135780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-66f44dc0-d4af-4acf-ba39-c39cf8cc9b19 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1452 microversion: 2.1 time: 0.156768 Jun 17 07:42:20.136443 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 358/726] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:19 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:20.232467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7322b89e-a564-4270-8e84-5f9c134d33db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:20.236506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7322b89e-a564-4270-8e84-5f9c134d33db tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.189271 Jun 17 07:42:20.237089 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 369/727] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:20 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:20.779980 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-edb53baf-50bf-446d-8b6b-eaffdc017381 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:20.780622 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-edb53baf-50bf-446d-8b6b-eaffdc017381 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:20.787270 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-edb53baf-50bf-446d-8b6b-eaffdc017381 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:20.787718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-edb53baf-50bf-446d-8b6b-eaffdc017381 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:20.789085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-edb53baf-50bf-446d-8b6b-eaffdc017381 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:20.789646 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-edb53baf-50bf-446d-8b6b-eaffdc017381 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:21.036088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-edb53baf-50bf-446d-8b6b-eaffdc017381 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:21.044659 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-edb53baf-50bf-446d-8b6b-eaffdc017381 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.268419 Jun 17 07:42:21.045248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 359/728] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:20 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:21.254933 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7757dc9f-5bff-44b2-8c33-25276d1f2746 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:21.255664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7757dc9f-5bff-44b2-8c33-25276d1f2746 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:21.262128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7757dc9f-5bff-44b2-8c33-25276d1f2746 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:21.262650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7757dc9f-5bff-44b2-8c33-25276d1f2746 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:21.263512 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7757dc9f-5bff-44b2-8c33-25276d1f2746 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:21.263845 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7757dc9f-5bff-44b2-8c33-25276d1f2746 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:21.402285 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7757dc9f-5bff-44b2-8c33-25276d1f2746 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:21.410147 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7757dc9f-5bff-44b2-8c33-25276d1f2746 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.159047 Jun 17 07:42:21.411065 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 370/729] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:21 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:22.061800 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-40bca1ea-9a89-4b1d-908b-d9ae92c40001 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:22.062430 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-40bca1ea-9a89-4b1d-908b-d9ae92c40001 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:22.068921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-40bca1ea-9a89-4b1d-908b-d9ae92c40001 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:22.069573 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-40bca1ea-9a89-4b1d-908b-d9ae92c40001 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:22.070684 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-40bca1ea-9a89-4b1d-908b-d9ae92c40001 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:22.071126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-40bca1ea-9a89-4b1d-908b-d9ae92c40001 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:22.224289 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-40bca1ea-9a89-4b1d-908b-d9ae92c40001 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:22.232440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-40bca1ea-9a89-4b1d-908b-d9ae92c40001 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.174371 Jun 17 07:42:22.233026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 360/730] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:22 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:22.312580 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-e0334a6e-e0f8-4f89-9a67-23b5b25a3f69 req-b10b26a1-d5ff-43ee-b446-b80b13d9d505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09674923-6d3d-4ad8-a777-4f1bfdeb77fc", "tag": "22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:22.322193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-e0334a6e-e0f8-4f89-9a67-23b5b25a3f69 req-b10b26a1-d5ff-43ee-b446-b80b13d9d505 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:22.322640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-e0334a6e-e0f8-4f89-9a67-23b5b25a3f69 req-b10b26a1-d5ff-43ee-b446-b80b13d9d505 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:22.334175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-e0334a6e-e0f8-4f89-9a67-23b5b25a3f69 req-b10b26a1-d5ff-43ee-b446-b80b13d9d505 service nova] Creating event network-changed:22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7 for instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc on hv-cinder-79733 Jun 17 07:42:22.339649 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-e0334a6e-e0f8-4f89-9a67-23b5b25a3f69 req-b10b26a1-d5ff-43ee-b446-b80b13d9d505 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030904 Jun 17 07:42:22.340272 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 371/731] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:42:22.428022 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3c2a3f64-e8a6-4de7-a464-9e60bfcc03d1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:22.429431 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3c2a3f64-e8a6-4de7-a464-9e60bfcc03d1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:22.436217 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c2a3f64-e8a6-4de7-a464-9e60bfcc03d1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:22.436903 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c2a3f64-e8a6-4de7-a464-9e60bfcc03d1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:22.437464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c2a3f64-e8a6-4de7-a464-9e60bfcc03d1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:22.438001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3c2a3f64-e8a6-4de7-a464-9e60bfcc03d1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:22.580013 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3c2a3f64-e8a6-4de7-a464-9e60bfcc03d1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:22.588628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3c2a3f64-e8a6-4de7-a464-9e60bfcc03d1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.164303 Jun 17 07:42:22.589232 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 361/732] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:22 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:23.251303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b80ec966-8bb4-4559-b3f7-1665994c6f2c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:23.251991 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b80ec966-8bb4-4559-b3f7-1665994c6f2c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:23.258924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b80ec966-8bb4-4559-b3f7-1665994c6f2c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:23.259386 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b80ec966-8bb4-4559-b3f7-1665994c6f2c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:23.260140 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b80ec966-8bb4-4559-b3f7-1665994c6f2c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:23.260569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b80ec966-8bb4-4559-b3f7-1665994c6f2c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:23.403182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b80ec966-8bb4-4559-b3f7-1665994c6f2c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:23.410914 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b80ec966-8bb4-4559-b3f7-1665994c6f2c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.163874 Jun 17 07:42:23.411491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 372/733] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:23 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:23.605937 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c4b715e9-4f94-45a2-ae93-7e5d3a10c9ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:23.606551 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c4b715e9-4f94-45a2-ae93-7e5d3a10c9ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:23.613286 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4b715e9-4f94-45a2-ae93-7e5d3a10c9ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:23.613772 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4b715e9-4f94-45a2-ae93-7e5d3a10c9ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:23.614551 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4b715e9-4f94-45a2-ae93-7e5d3a10c9ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:23.614992 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4b715e9-4f94-45a2-ae93-7e5d3a10c9ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:23.746015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c4b715e9-4f94-45a2-ae93-7e5d3a10c9ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:23.753429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c4b715e9-4f94-45a2-ae93-7e5d3a10c9ec tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.151355 Jun 17 07:42:23.754056 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 362/734] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:23 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:24.429139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-32cc9d08-644c-4d00-9da1-de07311371cc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:24.429712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-32cc9d08-644c-4d00-9da1-de07311371cc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:24.436313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-32cc9d08-644c-4d00-9da1-de07311371cc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:24.436763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-32cc9d08-644c-4d00-9da1-de07311371cc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:24.437561 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-32cc9d08-644c-4d00-9da1-de07311371cc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:24.438133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-32cc9d08-644c-4d00-9da1-de07311371cc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:24.571219 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-32cc9d08-644c-4d00-9da1-de07311371cc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:24.578751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-32cc9d08-644c-4d00-9da1-de07311371cc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.154196 Jun 17 07:42:24.579320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 373/735] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:24 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:24.771366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2435a0ae-d293-4c64-93df-18ca20436d89 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:24.771979 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2435a0ae-d293-4c64-93df-18ca20436d89 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:24.778698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2435a0ae-d293-4c64-93df-18ca20436d89 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:24.779146 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2435a0ae-d293-4c64-93df-18ca20436d89 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:24.779904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2435a0ae-d293-4c64-93df-18ca20436d89 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:24.780339 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2435a0ae-d293-4c64-93df-18ca20436d89 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:24.909993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2435a0ae-d293-4c64-93df-18ca20436d89 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:24.917879 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2435a0ae-d293-4c64-93df-18ca20436d89 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.150408 Jun 17 07:42:24.918443 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 363/736] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:24 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:25.595630 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9a80dee6-21d4-4ce3-8914-486194e0a854 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:25.596236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9a80dee6-21d4-4ce3-8914-486194e0a854 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:25.598661 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:25.604070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a80dee6-21d4-4ce3-8914-486194e0a854 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:25.604517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a80dee6-21d4-4ce3-8914-486194e0a854 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:25.605279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a80dee6-21d4-4ce3-8914-486194e0a854 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:25.605736 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a80dee6-21d4-4ce3-8914-486194e0a854 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:25.743782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9a80dee6-21d4-4ce3-8914-486194e0a854 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:25.751575 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9a80dee6-21d4-4ce3-8914-486194e0a854 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.159785 Jun 17 07:42:25.752149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 374/737] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:25 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:25.935912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-53145aa9-e341-48d6-a6b5-75473d5c7724 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:25.936467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-53145aa9-e341-48d6-a6b5-75473d5c7724 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:25.938918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:25.943813 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-53145aa9-e341-48d6-a6b5-75473d5c7724 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:25.944851 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-53145aa9-e341-48d6-a6b5-75473d5c7724 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:25.945716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-53145aa9-e341-48d6-a6b5-75473d5c7724 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:25.946134 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-53145aa9-e341-48d6-a6b5-75473d5c7724 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:26.078776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-53145aa9-e341-48d6-a6b5-75473d5c7724 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:26.086932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-53145aa9-e341-48d6-a6b5-75473d5c7724 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.154913 Jun 17 07:42:26.087507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 364/738] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:25 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:26.770362 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6c4680fb-9762-4d7b-bdb9-24ad7918591f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:26.770961 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6c4680fb-9762-4d7b-bdb9-24ad7918591f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:26.781117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6c4680fb-9762-4d7b-bdb9-24ad7918591f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:26.781903 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6c4680fb-9762-4d7b-bdb9-24ad7918591f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:26.783055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6c4680fb-9762-4d7b-bdb9-24ad7918591f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:26.783703 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6c4680fb-9762-4d7b-bdb9-24ad7918591f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:27.020579 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6c4680fb-9762-4d7b-bdb9-24ad7918591f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:27.028261 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6c4680fb-9762-4d7b-bdb9-24ad7918591f tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.261679 Jun 17 07:42:27.028870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 375/739] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:26 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:27.104474 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-aa9f52ae-6e12-42d2-8664-4a64ee6673b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:27.105060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-aa9f52ae-6e12-42d2-8664-4a64ee6673b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:27.111824 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-aa9f52ae-6e12-42d2-8664-4a64ee6673b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:27.112460 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-aa9f52ae-6e12-42d2-8664-4a64ee6673b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:27.113225 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-aa9f52ae-6e12-42d2-8664-4a64ee6673b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:27.113717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-aa9f52ae-6e12-42d2-8664-4a64ee6673b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:27.251124 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-aa9f52ae-6e12-42d2-8664-4a64ee6673b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:27.259226 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-aa9f52ae-6e12-42d2-8664-4a64ee6673b7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.159123 Jun 17 07:42:27.259811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 365/740] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:27 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:28.044990 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-820bcfc0-8d61-48f5-8e5a-413cbf8d8db4 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:28.045562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-820bcfc0-8d61-48f5-8e5a-413cbf8d8db4 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:28.052273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-820bcfc0-8d61-48f5-8e5a-413cbf8d8db4 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.052712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-820bcfc0-8d61-48f5-8e5a-413cbf8d8db4 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.053777 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-820bcfc0-8d61-48f5-8e5a-413cbf8d8db4 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.054355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-820bcfc0-8d61-48f5-8e5a-413cbf8d8db4 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.189654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-820bcfc0-8d61-48f5-8e5a-413cbf8d8db4 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:28.197434 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-820bcfc0-8d61-48f5-8e5a-413cbf8d8db4 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.156260 Jun 17 07:42:28.198015 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 376/741] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:28 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:28.237510 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-209f1590-773e-4c0a-b891-90848feb4e5e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:28.238060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-209f1590-773e-4c0a-b891-90848feb4e5e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:28.245384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-209f1590-773e-4c0a-b891-90848feb4e5e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.249292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-209f1590-773e-4c0a-b891-90848feb4e5e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.249292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-209f1590-773e-4c0a-b891-90848feb4e5e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.249292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-209f1590-773e-4c0a-b891-90848feb4e5e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.276423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c6ae4ba1-58a5-445f-bacb-2b120d56d1af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:28.278022 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c6ae4ba1-58a5-445f-bacb-2b120d56d1af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:28.278219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-209f1590-773e-4c0a-b891-90848feb4e5e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments/385921b4-affe-4e4b-99d5-8d41b58be9c8" status: 200 len: 194 microversion: 2.20 time: 0.044129 Jun 17 07:42:28.278219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 366/742] 10.222.0.52 () {60 vars in 1453 bytes} [Fri Jun 17 07:42:28 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments/385921b4-affe-4e4b-99d5-8d41b58be9c8 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:42:28.283427 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c6ae4ba1-58a5-445f-bacb-2b120d56d1af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.283906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c6ae4ba1-58a5-445f-bacb-2b120d56d1af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.285042 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c6ae4ba1-58a5-445f-bacb-2b120d56d1af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.285139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c6ae4ba1-58a5-445f-bacb-2b120d56d1af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.351627 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-31324415-6b87-4471-add8-40b0c2ad343a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:28.352106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-31324415-6b87-4471-add8-40b0c2ad343a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:28.358247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-31324415-6b87-4471-add8-40b0c2ad343a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.358698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-31324415-6b87-4471-add8-40b0c2ad343a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.359468 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-31324415-6b87-4471-add8-40b0c2ad343a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.360155 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-31324415-6b87-4471-add8-40b0c2ad343a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.449892 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-31324415-6b87-4471-add8-40b0c2ad343a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lazy-loading 'services' on Instance uuid 69ad6743-cfda-46c3-afaa-6d54e2e80a2f {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:42:28.456761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c6ae4ba1-58a5-445f-bacb-2b120d56d1af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:28.466271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c6ae4ba1-58a5-445f-bacb-2b120d56d1af tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.194106 Jun 17 07:42:28.476972 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 377/743] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:28 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:28.613418 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-31324415-6b87-4471-add8-40b0c2ad343a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments/385921b4-affe-4e4b-99d5-8d41b58be9c8" status: 202 len: 0 microversion: 2.20 time: 0.265572 Jun 17 07:42:28.614021 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 367/744] 10.222.0.52 () {60 vars in 1456 bytes} [Fri Jun 17 07:42:28 2022] DELETE /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments/385921b4-affe-4e4b-99d5-8d41b58be9c8 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:42:28.622444 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-56fd380a-057c-49cf-b713-fcdd427bf023 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:28.623474 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-56fd380a-057c-49cf-b713-fcdd427bf023 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:28.629475 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-56fd380a-057c-49cf-b713-fcdd427bf023 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.629918 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-56fd380a-057c-49cf-b713-fcdd427bf023 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.630664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-56fd380a-057c-49cf-b713-fcdd427bf023 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:28.631092 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-56fd380a-057c-49cf-b713-fcdd427bf023 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:28.661836 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-56fd380a-057c-49cf-b713-fcdd427bf023 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043219 Jun 17 07:42:28.662389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 378/745] 10.222.0.52 () {60 vars in 1342 bytes} [Fri Jun 17 07:42:28 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:42:29.215397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-66203282-9d62-4b52-a8be-bc92eb8746f6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:29.216006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-66203282-9d62-4b52-a8be-bc92eb8746f6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:29.222287 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-66203282-9d62-4b52-a8be-bc92eb8746f6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:29.222733 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-66203282-9d62-4b52-a8be-bc92eb8746f6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:29.223490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-66203282-9d62-4b52-a8be-bc92eb8746f6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:29.223925 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-66203282-9d62-4b52-a8be-bc92eb8746f6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:29.358307 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-66203282-9d62-4b52-a8be-bc92eb8746f6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:29.366617 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-66203282-9d62-4b52-a8be-bc92eb8746f6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.154991 Jun 17 07:42:29.367201 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 368/746] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:29 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:29.484201 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-97dc8149-fc23-41ea-a727-ec263f229250 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:29.484758 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-97dc8149-fc23-41ea-a727-ec263f229250 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:29.491896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97dc8149-fc23-41ea-a727-ec263f229250 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:29.492468 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97dc8149-fc23-41ea-a727-ec263f229250 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:29.493971 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97dc8149-fc23-41ea-a727-ec263f229250 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:29.494417 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97dc8149-fc23-41ea-a727-ec263f229250 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:29.642641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-97dc8149-fc23-41ea-a727-ec263f229250 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:29.650809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-97dc8149-fc23-41ea-a727-ec263f229250 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.170732 Jun 17 07:42:29.651389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 379/747] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:29 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:29.673739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-253c4742-e480-4fb9-9c4c-c84e9773dc81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:29.675028 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-253c4742-e480-4fb9-9c4c-c84e9773dc81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:29.681783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-253c4742-e480-4fb9-9c4c-c84e9773dc81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:29.682458 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-253c4742-e480-4fb9-9c4c-c84e9773dc81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:29.686746 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-253c4742-e480-4fb9-9c4c-c84e9773dc81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:29.686746 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-253c4742-e480-4fb9-9c4c-c84e9773dc81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:29.717179 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-253c4742-e480-4fb9-9c4c-c84e9773dc81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048058 Jun 17 07:42:29.717824 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 369/748] 10.222.0.52 () {60 vars in 1342 bytes} [Fri Jun 17 07:42:29 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:42:30.385292 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7a26897c-6c0a-465d-843e-060644927742 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:30.385860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7a26897c-6c0a-465d-843e-060644927742 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:30.392093 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7a26897c-6c0a-465d-843e-060644927742 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.392535 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7a26897c-6c0a-465d-843e-060644927742 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.393293 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7a26897c-6c0a-465d-843e-060644927742 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.393752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7a26897c-6c0a-465d-843e-060644927742 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.527571 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7a26897c-6c0a-465d-843e-060644927742 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:30.534993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7a26897c-6c0a-465d-843e-060644927742 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1570 microversion: 2.1 time: 0.155036 Jun 17 07:42:30.535557 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 380/749] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:30 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:30.551907 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-83df2172-be31-48c3-b252-9d765080d875 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:30.552475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-83df2172-be31-48c3-b252-9d765080d875 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:30.559638 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-83df2172-be31-48c3-b252-9d765080d875 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.560079 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-83df2172-be31-48c3-b252-9d765080d875 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.560834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-83df2172-be31-48c3-b252-9d765080d875 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.561266 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-83df2172-be31-48c3-b252-9d765080d875 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.668205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-844795dc-1bdc-476a-b392-1aa3ccbc5c31 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:30.669104 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-844795dc-1bdc-476a-b392-1aa3ccbc5c31 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:30.675234 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-844795dc-1bdc-476a-b392-1aa3ccbc5c31 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.675683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-844795dc-1bdc-476a-b392-1aa3ccbc5c31 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.676451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-844795dc-1bdc-476a-b392-1aa3ccbc5c31 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.676964 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-844795dc-1bdc-476a-b392-1aa3ccbc5c31 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.698547 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:30.819476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-844795dc-1bdc-476a-b392-1aa3ccbc5c31 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:30.828596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-844795dc-1bdc-476a-b392-1aa3ccbc5c31 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1678 microversion: 2.1 time: 0.164347 Jun 17 07:42:30.831389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 381/750] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:30 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:30.834229 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2346872d-3c0e-4dae-8780-cf94540585aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:30.835140 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2346872d-3c0e-4dae-8780-cf94540585aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:30.840559 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-83df2172-be31-48c3-b252-9d765080d875 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "POST /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915/action" status: 202 len: 0 microversion: 2.1 time: 0.292471 Jun 17 07:42:30.842506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2346872d-3c0e-4dae-8780-cf94540585aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.843163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2346872d-3c0e-4dae-8780-cf94540585aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.844257 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2346872d-3c0e-4dae-8780-cf94540585aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.844344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2346872d-3c0e-4dae-8780-cf94540585aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.844761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 370/751] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:42:30 2022] POST /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:42:30.849701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b388610f-f269-4f5b-87c4-17b8d31ee5da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:30.850123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b388610f-f269-4f5b-87c4-17b8d31ee5da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:30.856811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b388610f-f269-4f5b-87c4-17b8d31ee5da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.857345 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b388610f-f269-4f5b-87c4-17b8d31ee5da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.858068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b388610f-f269-4f5b-87c4-17b8d31ee5da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.858502 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b388610f-f269-4f5b-87c4-17b8d31ee5da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.877060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2346872d-3c0e-4dae-8780-cf94540585aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046468 Jun 17 07:42:30.877853 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 382/752] 10.222.0.52 () {60 vars in 1342 bytes} [Fri Jun 17 07:42:30 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:30.956305 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-00282869-bbc8-4fd3-bc0c-e21ce46b1216 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:30.957159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-00282869-bbc8-4fd3-bc0c-e21ce46b1216 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:30.966092 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-00282869-bbc8-4fd3-bc0c-e21ce46b1216 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.966619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-00282869-bbc8-4fd3-bc0c-e21ce46b1216 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:30.967460 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-00282869-bbc8-4fd3-bc0c-e21ce46b1216 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:30.968126 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-00282869-bbc8-4fd3-bc0c-e21ce46b1216 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:31.003643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-00282869-bbc8-4fd3-bc0c-e21ce46b1216 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Going to try to terminate instance {{(pid=124472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:42:31.010440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b388610f-f269-4f5b-87c4-17b8d31ee5da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:31.015145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:31.021518 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b388610f-f269-4f5b-87c4-17b8d31ee5da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1578 microversion: 2.1 time: 0.175642 Jun 17 07:42:31.031620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 371/753] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:30 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:31.324043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-00282869-bbc8-4fd3-bc0c-e21ce46b1216 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 204 len: 0 microversion: 2.20 time: 0.386761 Jun 17 07:42:31.325206 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 383/754] 10.222.0.52 () {60 vars in 1279 bytes} [Fri Jun 17 07:42:30 2022] DELETE /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 17 07:42:31.333999 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:31.334604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:31.341003 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:31.341473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:31.342238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:31.342663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:31.481491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:31.488348 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:31.489876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:31.491032 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-00ec954e-ae65-4b00-bc66-ece1bc344b88 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.161574 Jun 17 07:42:31.491775 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 372/755] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:31 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:42:31.847203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-abf33eae-815c-41be-b5ac-d7cf3022acaf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:31.847910 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-abf33eae-815c-41be-b5ac-d7cf3022acaf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:31.855428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-abf33eae-815c-41be-b5ac-d7cf3022acaf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:31.855871 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-abf33eae-815c-41be-b5ac-d7cf3022acaf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:31.856619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-abf33eae-815c-41be-b5ac-d7cf3022acaf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:31.857048 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-abf33eae-815c-41be-b5ac-d7cf3022acaf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:31.989147 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-abf33eae-815c-41be-b5ac-d7cf3022acaf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:31.997462 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-abf33eae-815c-41be-b5ac-d7cf3022acaf tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1655 microversion: 2.1 time: 0.154370 Jun 17 07:42:31.998021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 384/756] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:31 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:32.014648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6efa4e53-c2ac-4c61-a74d-c1a1669e2faa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:32.021210 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6efa4e53-c2ac-4c61-a74d-c1a1669e2faa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:32.021694 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6efa4e53-c2ac-4c61-a74d-c1a1669e2faa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:32.038976 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b89b779a-94bb-499c-b5e0-a02f2cd84d06 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:32.040164 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b89b779a-94bb-499c-b5e0-a02f2cd84d06 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:32.046302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b89b779a-94bb-499c-b5e0-a02f2cd84d06 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:32.046741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b89b779a-94bb-499c-b5e0-a02f2cd84d06 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:32.047496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b89b779a-94bb-499c-b5e0-a02f2cd84d06 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:32.047921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b89b779a-94bb-499c-b5e0-a02f2cd84d06 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:32.085818 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6efa4e53-c2ac-4c61-a74d-c1a1669e2faa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Going to try to start instance {{(pid=124471) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 07:42:32.187192 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b89b779a-94bb-499c-b5e0-a02f2cd84d06 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:32.194677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b89b779a-94bb-499c-b5e0-a02f2cd84d06 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1518 microversion: 2.1 time: 0.159453 Jun 17 07:42:32.195273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 385/757] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:32 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:32.302638 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6efa4e53-c2ac-4c61-a74d-c1a1669e2faa tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/action" status: 202 len: 0 microversion: 2.1 time: 0.291993 Jun 17 07:42:32.303236 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 373/758] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:42:32 2022] POST /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:42:32.311231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1f6edc85-db6d-4e02-a7f5-73badd437885 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:32.311822 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1f6edc85-db6d-4e02-a7f5-73badd437885 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:32.317830 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6edc85-db6d-4e02-a7f5-73badd437885 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:32.321349 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6edc85-db6d-4e02-a7f5-73badd437885 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:32.321349 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6edc85-db6d-4e02-a7f5-73badd437885 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:32.321349 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1f6edc85-db6d-4e02-a7f5-73badd437885 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:32.448148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-34b4201d-685a-4f02-a677-755b3993ccbe req-5de63af8-fb93-4c7d-8dde-777386982296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a5406c-f3f3-41ee-b763-cfcabfa91915", "name": "network-vif-unplugged", "status": "completed", "tag": "745661a1-a356-4257-97ca-68167916d2cd"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:32.456520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1f6edc85-db6d-4e02-a7f5-73badd437885 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:32.457562 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-34b4201d-685a-4f02-a677-755b3993ccbe req-5de63af8-fb93-4c7d-8dde-777386982296 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:32.458006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-34b4201d-685a-4f02-a677-755b3993ccbe req-5de63af8-fb93-4c7d-8dde-777386982296 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:32.464814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1f6edc85-db6d-4e02-a7f5-73badd437885 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1664 microversion: 2.1 time: 0.157313 Jun 17 07:42:32.465508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 386/759] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:32 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:32.469334 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.compute.server_external_events [req-34b4201d-685a-4f02-a677-755b3993ccbe req-5de63af8-fb93-4c7d-8dde-777386982296 service nova] Unable to find a host for instance d0a5406c-f3f3-41ee-b763-cfcabfa91915. Dropping event network-vif-unplugged {{(pid=124471) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 07:42:32.478375 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-34b4201d-685a-4f02-a677-755b3993ccbe req-5de63af8-fb93-4c7d-8dde-777386982296 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027792 Jun 17 07:42:32.478375 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 374/760] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 17 07:42:32.510865 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:32.511576 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:32.517689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:32.518182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:32.518967 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:32.519375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:32.655275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:32.663387 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:32.665519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:32.666797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7ebb54e3-acb8-4555-ad0d-28591ce21e7c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.160877 Jun 17 07:42:32.667381 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 387/761] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:32 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:33.212616 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-adfdaac5-384a-4d8e-9446-0bc9aadd7484 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:33.213373 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-adfdaac5-384a-4d8e-9446-0bc9aadd7484 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:33.219905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-adfdaac5-384a-4d8e-9446-0bc9aadd7484 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:33.220356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-adfdaac5-384a-4d8e-9446-0bc9aadd7484 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:33.221148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-adfdaac5-384a-4d8e-9446-0bc9aadd7484 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:33.221618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-adfdaac5-384a-4d8e-9446-0bc9aadd7484 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:33.358056 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-adfdaac5-384a-4d8e-9446-0bc9aadd7484 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:33.365774 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-adfdaac5-384a-4d8e-9446-0bc9aadd7484 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1520 microversion: 2.1 time: 0.157552 Jun 17 07:42:33.366358 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 375/762] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:33 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:33.483567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-502eb0d9-eb44-48ff-87db-d6c634262144 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:33.484290 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-502eb0d9-eb44-48ff-87db-d6c634262144 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:33.491304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-502eb0d9-eb44-48ff-87db-d6c634262144 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:33.491755 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-502eb0d9-eb44-48ff-87db-d6c634262144 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:33.492742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-502eb0d9-eb44-48ff-87db-d6c634262144 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:33.493047 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-502eb0d9-eb44-48ff-87db-d6c634262144 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:33.688907 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:33.690045 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:33.700381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:33.701351 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:33.706449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:33.706449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:33.716614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-502eb0d9-eb44-48ff-87db-d6c634262144 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:33.730332 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-502eb0d9-eb44-48ff-87db-d6c634262144 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1664 microversion: 2.1 time: 0.249987 Jun 17 07:42:33.730970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 388/763] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:33 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1664 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:33.987526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:33.998580 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:34.000402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:34.001625 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2e62f091-704e-4eef-baef-9b457eef676e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1721 microversion: 2.20 time: 0.321478 Jun 17 07:42:34.002196 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 376/764] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:33 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:34.383765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fc501857-d313-4822-a8d7-90682ea53ef9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:34.384866 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fc501857-d313-4822-a8d7-90682ea53ef9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:34.391123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc501857-d313-4822-a8d7-90682ea53ef9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:34.393402 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc501857-d313-4822-a8d7-90682ea53ef9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:34.393402 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc501857-d313-4822-a8d7-90682ea53ef9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:34.393402 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fc501857-d313-4822-a8d7-90682ea53ef9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:34.536201 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fc501857-d313-4822-a8d7-90682ea53ef9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:34.544978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fc501857-d313-4822-a8d7-90682ea53ef9 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1520 microversion: 2.1 time: 0.165104 Jun 17 07:42:34.545612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 389/765] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:34 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:34.748636 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d61f46a8-4a9c-4e4e-9cb9-460e447e3e26 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:34.749382 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d61f46a8-4a9c-4e4e-9cb9-460e447e3e26 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:34.755752 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d61f46a8-4a9c-4e4e-9cb9-460e447e3e26 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:34.756279 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d61f46a8-4a9c-4e4e-9cb9-460e447e3e26 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:34.757125 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d61f46a8-4a9c-4e4e-9cb9-460e447e3e26 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:34.757653 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d61f46a8-4a9c-4e4e-9cb9-460e447e3e26 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:34.899369 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-20ba63d8-4a30-4d1b-8550-a8dffd92f2c0 req-b7a8bb55-5e51-4cfa-b376-ad51d3d260fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ad6743-cfda-46c3-afaa-6d54e2e80a2f", "name": "network-vif-deleted", "tag": "1ce3a745-be88-4264-b1e5-51f76662590d"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:34.908487 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-20ba63d8-4a30-4d1b-8550-a8dffd92f2c0 req-b7a8bb55-5e51-4cfa-b376-ad51d3d260fd service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:34.909035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-20ba63d8-4a30-4d1b-8550-a8dffd92f2c0 req-b7a8bb55-5e51-4cfa-b376-ad51d3d260fd service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:34.923455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-20ba63d8-4a30-4d1b-8550-a8dffd92f2c0 req-b7a8bb55-5e51-4cfa-b376-ad51d3d260fd service nova] Creating event network-vif-deleted:1ce3a745-be88-4264-b1e5-51f76662590d for instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f on hv-cinder-79733 Jun 17 07:42:34.929017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-20ba63d8-4a30-4d1b-8550-a8dffd92f2c0 req-b7a8bb55-5e51-4cfa-b376-ad51d3d260fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 Jun 17 07:42:34.929760 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 390/766] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:42:34.951147 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d61f46a8-4a9c-4e4e-9cb9-460e447e3e26 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:34.959238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d61f46a8-4a9c-4e4e-9cb9-460e447e3e26 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1668 microversion: 2.1 time: 0.214389 Jun 17 07:42:34.959831 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 377/767] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:34 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1668 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:35.020908 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:35.021672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:35.028927 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:35.029387 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:35.030167 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:35.030608 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:35.110346 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:35.120668 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:35.122745 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:35.124033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-742e8e4d-553c-4d04-b755-313cd8e1909c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1654 microversion: 2.20 time: 0.107563 Jun 17 07:42:35.124696 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 391/768] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:35 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:35.562812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3044ae4d-3692-4eae-8087-4763969a7f77 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:35.563769 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3044ae4d-3692-4eae-8087-4763969a7f77 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:35.573934 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3044ae4d-3692-4eae-8087-4763969a7f77 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:35.574685 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3044ae4d-3692-4eae-8087-4763969a7f77 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:35.575531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3044ae4d-3692-4eae-8087-4763969a7f77 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:35.576044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3044ae4d-3692-4eae-8087-4763969a7f77 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:35.717530 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3044ae4d-3692-4eae-8087-4763969a7f77 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:35.725612 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3044ae4d-3692-4eae-8087-4763969a7f77 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1520 microversion: 2.1 time: 0.166977 Jun 17 07:42:35.726206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 378/769] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:35 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:36.143943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:36.144554 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:36.152091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:36.152540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:36.153401 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:36.153842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:36.186340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:36.186791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:36.187235 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lazy-loading 'fault' on Instance uuid 69ad6743-cfda-46c3-afaa-6d54e2e80a2f {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:42:36.230286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:36.239265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:36.240746 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:36.241930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e27f0afb-52d4-4201-9545-5b3765bf71dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 200 len: 1370 microversion: 2.20 time: 0.102765 Jun 17 07:42:36.243079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 392/770] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:36 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:36.743531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8d45b66a-e163-43fb-8339-fad83c0d52aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:36.744136 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8d45b66a-e163-43fb-8339-fad83c0d52aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:36.750562 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d45b66a-e163-43fb-8339-fad83c0d52aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:36.750950 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d45b66a-e163-43fb-8339-fad83c0d52aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:36.751707 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d45b66a-e163-43fb-8339-fad83c0d52aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:36.752135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d45b66a-e163-43fb-8339-fad83c0d52aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:36.910612 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8d45b66a-e163-43fb-8339-fad83c0d52aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:36.919007 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8d45b66a-e163-43fb-8339-fad83c0d52aa tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.179380 Jun 17 07:42:36.919767 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 379/771] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:36 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:37.265644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:37.266165 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:37.272528 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:37.272968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:37.273923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:37.274431 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:37.287597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] HTTP exception thrown: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Request method failure captured: Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f HTTP/1.1 Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6Nsmc1yzqvqKNjICcvO3dTRPXFb3dnL7cBj2sLip3Wz-omtLo3gsp53KXpLq_P1GEAwFFhoZvQTpA5RqtpK15pcOG5ivLeD9Jv5UVDO70e6SEphjHDipX4E4mUe1o2qX7f11CA9h-yzLTkV79EmGEvri41VrwTTEeDaoivEUJewoo Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:42:37.289729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8432e3c517624c449606ca1201f2be12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8432e3c517624c449606ca1201f2be12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: a3ea40ad7d7546449f60539341abc545 Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:42:37.291532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '69ad6743-cfda-46c3-afaa-6d54e2e80a2f'} Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:42:37.292440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:42:37.294020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:42:37.295430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Returning 404 to user: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:42:37.295430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7957293b-1557-4a3b-a515-0a2f976fbd00 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 404 len: 111 microversion: 2.20 time: 0.029560 Jun 17 07:42:37.295430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 393/772] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:37 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:42:37.300177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ca3107bf-1fe0-4698-8bbc-cbf1504aa399 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '.version_select at 0x7fb069b7bd30>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:37.406466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ca3107bf-1fe0-4698-8bbc-cbf1504aa399 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751308533" status: 204 len: 0 microversion: 2.20 time: 0.110066 Jun 17 07:42:37.407090 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 380/773] 10.222.0.52 () {60 vars in 1258 bytes} [Fri Jun 17 07:42:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751308533 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 07:42:37.937149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ae8230d6-2639-4382-8a7a-d74ce4ff3f00 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:37.937694 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ae8230d6-2639-4382-8a7a-d74ce4ff3f00 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:37.943787 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae8230d6-2639-4382-8a7a-d74ce4ff3f00 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:37.944236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae8230d6-2639-4382-8a7a-d74ce4ff3f00 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:37.945092 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae8230d6-2639-4382-8a7a-d74ce4ff3f00 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:37.946872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ae8230d6-2639-4382-8a7a-d74ce4ff3f00 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:38.159225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ae8230d6-2639-4382-8a7a-d74ce4ff3f00 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:38.168039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ae8230d6-2639-4382-8a7a-d74ce4ff3f00 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.234364 Jun 17 07:42:38.169317 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 394/774] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:37 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:38.223085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9019eb41-b398-459b-ae09-9474746a4605 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'create', calling method: .version_select at 0x7fb069b563a0>, body: {"keypair": {"name": "tempest-keypair-581966650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC57GdXoNDyRiFEBkWdKji1cw55PMtHpERlZWKHMuR+Yt+tc3c3sCRy4cSiQmK5dI36bV7eOFMMUjYIH0oils0I9AM2ZcsoFydF/JzdI6pyRQnQGnpizT2WEWafh62GmMA=="}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:38.241567 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-9019eb41-b398-459b-ae09-9474746a4605 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Getting quotas for project 8432e3c517624c449606ca1201f2be12. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:42:38.246979 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-9019eb41-b398-459b-ae09-9474746a4605 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Getting quotas for user a3ea40ad7d7546449f60539341abc545 and project 8432e3c517624c449606ca1201f2be12. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:42:38.318226 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9019eb41-b398-459b-ae09-9474746a4605 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.099689 Jun 17 07:42:38.318835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 381/775] 10.222.0.52 () {62 vars in 1199 bytes} [Fri Jun 17 07:42:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 07:42:39.187157 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-65ce6427-c1ba-4e4f-8410-a8af9f385548 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:39.187780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-65ce6427-c1ba-4e4f-8410-a8af9f385548 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:39.194701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-65ce6427-c1ba-4e4f-8410-a8af9f385548 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:39.195155 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-65ce6427-c1ba-4e4f-8410-a8af9f385548 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:39.196775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-65ce6427-c1ba-4e4f-8410-a8af9f385548 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:39.197364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-65ce6427-c1ba-4e4f-8410-a8af9f385548 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:39.338691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-65ce6427-c1ba-4e4f-8410-a8af9f385548 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:39.346716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-65ce6427-c1ba-4e4f-8410-a8af9f385548 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.163476 Jun 17 07:42:39.347293 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 395/776] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:39 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:40.364860 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-70d7613d-141a-4f3a-a785-2678911eff48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:40.365531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-70d7613d-141a-4f3a-a785-2678911eff48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:40.372305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-70d7613d-141a-4f3a-a785-2678911eff48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:40.372758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-70d7613d-141a-4f3a-a785-2678911eff48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:40.373552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-70d7613d-141a-4f3a-a785-2678911eff48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:40.374044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-70d7613d-141a-4f3a-a785-2678911eff48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:40.507327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1509022328", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab57126c-dcfa-47e4-89e8-e968083b17b8"}], "security_groups": [{"name": "tempest-securitygroup--170674701"}], "key_name": "tempest-keypair-581966650", "user_data": "}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:40.518905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-70d7613d-141a-4f3a-a785-2678911eff48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:40.526405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-70d7613d-141a-4f3a-a785-2678911eff48 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.166006 Jun 17 07:42:40.527051 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 382/777] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:40 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:40.613199 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] validate_networks() for [('ab57126c-dcfa-47e4-89e8-e968083b17b8', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:42:40.978060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:42:40.978492 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:42:40.978996 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:42:40.979438 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:42:40.979862 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:42:40.988987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:40.989490 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:40.990294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:40.990735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:41.006998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Getting quotas for project 8432e3c517624c449606ca1201f2be12. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:42:41.011500 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Getting quotas for user a3ea40ad7d7546449f60539341abc545 and project 8432e3c517624c449606ca1201f2be12. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:42:41.022335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:42:41.025203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:42:41.162424 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-805fbb09-90e6-405c-ae6f-e2ff7534eed7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.659395 Jun 17 07:42:41.163072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 396/778] 10.222.0.52 () {62 vars in 1187 bytes} [Fri Jun 17 07:42:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 07:42:41.173492 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-68737aec-d84c-49bc-a95d-1720ce56d144 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:41.174360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-68737aec-d84c-49bc-a95d-1720ce56d144 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:41.227632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-68737aec-d84c-49bc-a95d-1720ce56d144 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:41.235231 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-68737aec-d84c-49bc-a95d-1720ce56d144 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:41.236751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-68737aec-d84c-49bc-a95d-1720ce56d144 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:41.237887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-68737aec-d84c-49bc-a95d-1720ce56d144 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1281 microversion: 2.20 time: 0.068476 Jun 17 07:42:41.238749 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 383/779] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:41 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:41.544827 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c91150e9-cb6f-432b-9d5b-cb4170ebfce1 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:41.545643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c91150e9-cb6f-432b-9d5b-cb4170ebfce1 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:41.552204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c91150e9-cb6f-432b-9d5b-cb4170ebfce1 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:41.552653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c91150e9-cb6f-432b-9d5b-cb4170ebfce1 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:41.553449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c91150e9-cb6f-432b-9d5b-cb4170ebfce1 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:41.553886 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c91150e9-cb6f-432b-9d5b-cb4170ebfce1 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:41.694228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c91150e9-cb6f-432b-9d5b-cb4170ebfce1 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:41.703106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c91150e9-cb6f-432b-9d5b-cb4170ebfce1 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.162698 Jun 17 07:42:41.703678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 397/780] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:41 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:42.256384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:42.257121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:42.264750 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:42.265114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:42.265915 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:42.266344 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:42.331657 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:42.339663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:42.341155 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:42.342328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e71d6623-7196-4e3c-ba61-213a73b6b844 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1285 microversion: 2.20 time: 0.089985 Jun 17 07:42:42.342882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 384/781] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:42 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:42.720294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fd63cb75-c4d1-436f-9b7a-db7ae976b8fc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:42.720932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fd63cb75-c4d1-436f-9b7a-db7ae976b8fc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:42.727739 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd63cb75-c4d1-436f-9b7a-db7ae976b8fc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:42.728183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd63cb75-c4d1-436f-9b7a-db7ae976b8fc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:42.728938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd63cb75-c4d1-436f-9b7a-db7ae976b8fc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:42.729404 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd63cb75-c4d1-436f-9b7a-db7ae976b8fc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:42.733455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:42.861685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fd63cb75-c4d1-436f-9b7a-db7ae976b8fc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:42.870299 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fd63cb75-c4d1-436f-9b7a-db7ae976b8fc tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.153800 Jun 17 07:42:42.870870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 398/782] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:42 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:43.361080 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:43.361813 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:43.368662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:43.369137 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:43.369932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:43.370362 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:43.431831 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:43.439768 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:43.441278 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:43.442400 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-df4e63df-1920-4a7a-8431-4b2a445bc9b7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1341 microversion: 2.20 time: 0.085614 Jun 17 07:42:43.442957 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 385/783] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:43 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:43.887924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-53e3f68f-cbc3-4342-a3d0-0e8b76ef9a02 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:43.888544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-53e3f68f-cbc3-4342-a3d0-0e8b76ef9a02 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:43.894916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53e3f68f-cbc3-4342-a3d0-0e8b76ef9a02 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:43.895355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53e3f68f-cbc3-4342-a3d0-0e8b76ef9a02 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:43.896101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53e3f68f-cbc3-4342-a3d0-0e8b76ef9a02 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:43.896529 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53e3f68f-cbc3-4342-a3d0-0e8b76ef9a02 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:44.029307 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-53e3f68f-cbc3-4342-a3d0-0e8b76ef9a02 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:44.036851 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-53e3f68f-cbc3-4342-a3d0-0e8b76ef9a02 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.152806 Jun 17 07:42:44.037441 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 399/784] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:43 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:44.460077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:44.461478 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:44.468205 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:44.468867 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:44.469460 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:44.469900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:44.559614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:44.568028 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:44.569785 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:44.571474 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ad858f62-8a05-474b-a369-64a6a38aaac9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1341 microversion: 2.20 time: 0.115322 Jun 17 07:42:44.572183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 386/785] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:44 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1341 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:44.584698 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a4be7640-20c7-44cc-bb44-d9b5c1209831 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:44.585190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a4be7640-20c7-44cc-bb44-d9b5c1209831 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:44.591616 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a4be7640-20c7-44cc-bb44-d9b5c1209831 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:44.596422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a4be7640-20c7-44cc-bb44-d9b5c1209831 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:44.596422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a4be7640-20c7-44cc-bb44-d9b5c1209831 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:44.596422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a4be7640-20c7-44cc-bb44-d9b5c1209831 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:44.677725 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-a4be7640-20c7-44cc-bb44-d9b5c1209831 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lazy-loading 'services' on Instance uuid c1866c92-f2f4-49e4-b391-ffca4b0ce35b {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:42:44.886011 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a4be7640-20c7-44cc-bb44-d9b5c1209831 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments/bcccb341-4a43-441c-98e2-f49bc99bbc8d" status: 202 len: 0 microversion: 2.1 time: 0.304869 Jun 17 07:42:44.886750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 400/786] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:42:44 2022] DELETE /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments/bcccb341-4a43-441c-98e2-f49bc99bbc8d => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:42:44.895366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b7bda0f2-ce4b-45fd-85ec-1442bf317b7c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:44.896293 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b7bda0f2-ce4b-45fd-85ec-1442bf317b7c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:44.902723 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7bda0f2-ce4b-45fd-85ec-1442bf317b7c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:44.903171 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7bda0f2-ce4b-45fd-85ec-1442bf317b7c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:44.903935 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7bda0f2-ce4b-45fd-85ec-1442bf317b7c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:44.904377 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7bda0f2-ce4b-45fd-85ec-1442bf317b7c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:44.935045 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b7bda0f2-ce4b-45fd-85ec-1442bf317b7c tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043616 Jun 17 07:42:44.935536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 387/787] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:42:44 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:42:45.054873 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-89454c02-d471-42c4-8fc7-3e0fd2cb558e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:45.055603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-89454c02-d471-42c4-8fc7-3e0fd2cb558e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:45.062396 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89454c02-d471-42c4-8fc7-3e0fd2cb558e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:45.062853 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89454c02-d471-42c4-8fc7-3e0fd2cb558e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:45.063621 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89454c02-d471-42c4-8fc7-3e0fd2cb558e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:45.064058 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-89454c02-d471-42c4-8fc7-3e0fd2cb558e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:45.250430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-89454c02-d471-42c4-8fc7-3e0fd2cb558e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:45.257009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-89454c02-d471-42c4-8fc7-3e0fd2cb558e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.206461 Jun 17 07:42:45.257720 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 401/788] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:45 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:45.589411 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:45.590029 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:45.596405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:45.596849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:45.597636 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:45.598065 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:45.784571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:45.794493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:45.796314 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:45.797575 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0882abf3-eca2-4373-89aa-65dfc5dc5623 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.212733 Jun 17 07:42:45.798142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 388/789] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:45 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:45.951692 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0f0f4844-7a4f-47f3-bb01-bcf8209a910a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:45.952815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0f0f4844-7a4f-47f3-bb01-bcf8209a910a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:45.959160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f0f4844-7a4f-47f3-bb01-bcf8209a910a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:45.959604 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f0f4844-7a4f-47f3-bb01-bcf8209a910a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:45.960569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f0f4844-7a4f-47f3-bb01-bcf8209a910a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:45.961401 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0f0f4844-7a4f-47f3-bb01-bcf8209a910a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:45.993630 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0f0f4844-7a4f-47f3-bb01-bcf8209a910a tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049202 Jun 17 07:42:45.994219 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 402/790] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:42:45 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:42:46.275205 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b9c3f852-e1ac-45b0-acee-6da87323aa1c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:46.275834 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b9c3f852-e1ac-45b0-acee-6da87323aa1c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:46.282240 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b9c3f852-e1ac-45b0-acee-6da87323aa1c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:46.282699 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b9c3f852-e1ac-45b0-acee-6da87323aa1c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:46.283504 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b9c3f852-e1ac-45b0-acee-6da87323aa1c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:46.284238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b9c3f852-e1ac-45b0-acee-6da87323aa1c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:46.448819 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b9c3f852-e1ac-45b0-acee-6da87323aa1c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:46.456909 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b9c3f852-e1ac-45b0-acee-6da87323aa1c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.185708 Jun 17 07:42:46.457530 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 389/791] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:46 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:46.552165 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-6ba5c9b5-60d1-4662-8a24-812ae76bd6ed req-5af53132-50a7-467d-bf09-2d25d7c75346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871cb913-ba89-4924-8a2c-ad61a797c36b", "tag": "801e37b2-c880-4c3a-a5bd-cdf86430b915"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:46.566113 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-6ba5c9b5-60d1-4662-8a24-812ae76bd6ed req-5af53132-50a7-467d-bf09-2d25d7c75346 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:46.566650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-6ba5c9b5-60d1-4662-8a24-812ae76bd6ed req-5af53132-50a7-467d-bf09-2d25d7c75346 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:46.581661 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-6ba5c9b5-60d1-4662-8a24-812ae76bd6ed req-5af53132-50a7-467d-bf09-2d25d7c75346 service nova] Creating event network-changed:801e37b2-c880-4c3a-a5bd-cdf86430b915 for instance 871cb913-ba89-4924-8a2c-ad61a797c36b on hv-cinder-79733 Jun 17 07:42:46.587186 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-6ba5c9b5-60d1-4662-8a24-812ae76bd6ed req-5af53132-50a7-467d-bf09-2d25d7c75346 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038948 Jun 17 07:42:46.587944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 403/792] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:42:46.816098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:46.818238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:46.825872 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:46.826436 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:46.827192 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:46.827643 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.005599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c4521302-af5e-4940-a0e2-afc73af40e44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:47.006799 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c4521302-af5e-4940-a0e2-afc73af40e44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:47.013964 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c4521302-af5e-4940-a0e2-afc73af40e44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:47.014655 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c4521302-af5e-4940-a0e2-afc73af40e44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.015418 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c4521302-af5e-4940-a0e2-afc73af40e44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:47.015849 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c4521302-af5e-4940-a0e2-afc73af40e44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.047278 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c4521302-af5e-4940-a0e2-afc73af40e44 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045869 Jun 17 07:42:47.047860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 404/793] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:42:46 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:42:47.125575 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ba8b4bf3-9626-4cac-a1e2-3e1e5e5d9b94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:47.126062 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ba8b4bf3-9626-4cac-a1e2-3e1e5e5d9b94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:47.132091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba8b4bf3-9626-4cac-a1e2-3e1e5e5d9b94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:47.136002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba8b4bf3-9626-4cac-a1e2-3e1e5e5d9b94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.136002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba8b4bf3-9626-4cac-a1e2-3e1e5e5d9b94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:47.136002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba8b4bf3-9626-4cac-a1e2-3e1e5e5d9b94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.159967 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ba8b4bf3-9626-4cac-a1e2-3e1e5e5d9b94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Going to try to terminate instance {{(pid=124472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:42:47.214402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:47.222995 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:47.224515 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:47.225662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f2ac1e29-185c-4056-bc0c-d7c8ce2981e4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.414088 Jun 17 07:42:47.226913 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 390/794] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:46 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:47.474321 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0123f913-b7b0-4fbc-8c60-8326767b2d99 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:47.474966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0123f913-b7b0-4fbc-8c60-8326767b2d99 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:47.481985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0123f913-b7b0-4fbc-8c60-8326767b2d99 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:47.482467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0123f913-b7b0-4fbc-8c60-8326767b2d99 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.483248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0123f913-b7b0-4fbc-8c60-8326767b2d99 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:47.483689 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0123f913-b7b0-4fbc-8c60-8326767b2d99 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.488155 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:47.502432 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ba8b4bf3-9626-4cac-a1e2-3e1e5e5d9b94 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 204 len: 0 microversion: 2.1 time: 0.380332 Jun 17 07:42:47.503021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 405/795] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:42:47 2022] DELETE /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:42:47.511453 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-750cb98a-3586-49e9-8691-a9cea7300977 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:47.512158 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-750cb98a-3586-49e9-8691-a9cea7300977 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:47.518497 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-750cb98a-3586-49e9-8691-a9cea7300977 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:47.518946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-750cb98a-3586-49e9-8691-a9cea7300977 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.522146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-750cb98a-3586-49e9-8691-a9cea7300977 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:47.522146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-750cb98a-3586-49e9-8691-a9cea7300977 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:47.628331 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0123f913-b7b0-4fbc-8c60-8326767b2d99 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:47.637093 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0123f913-b7b0-4fbc-8c60-8326767b2d99 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.166641 Jun 17 07:42:47.637716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 391/796] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:47 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:47.807482 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-750cb98a-3586-49e9-8691-a9cea7300977 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:47.814862 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-750cb98a-3586-49e9-8691-a9cea7300977 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1690 microversion: 2.1 time: 0.307629 Jun 17 07:42:47.815421 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 406/797] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:47 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1690 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:48.245135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:48.245807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:48.252653 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:48.253091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:48.253877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:48.254312 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:48.386590 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:48.394383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:48.395877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:48.396991 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a647c973-1aae-4067-9448-ea1180394c4c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.156934 Jun 17 07:42:48.397576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 392/798] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:48 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:48.555623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-8cc98f99-d517-4665-9b83-b628a2c00743 req-68d57532-0133-478f-b0b4-8a2ff71a7775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a5406c-f3f3-41ee-b763-cfcabfa91915", "name": "network-vif-plugged", "status": "completed", "tag": "745661a1-a356-4257-97ca-68167916d2cd"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:48.563646 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-8cc98f99-d517-4665-9b83-b628a2c00743 req-68d57532-0133-478f-b0b4-8a2ff71a7775 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:48.564090 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-8cc98f99-d517-4665-9b83-b628a2c00743 req-68d57532-0133-478f-b0b4-8a2ff71a7775 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:48.575360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-8cc98f99-d517-4665-9b83-b628a2c00743 req-68d57532-0133-478f-b0b4-8a2ff71a7775 service nova] Creating event network-vif-plugged:745661a1-a356-4257-97ca-68167916d2cd for instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 on hv-cinder-79733 Jun 17 07:42:48.580468 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-8cc98f99-d517-4665-9b83-b628a2c00743 req-68d57532-0133-478f-b0b4-8a2ff71a7775 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029073 Jun 17 07:42:48.581040 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 407/799] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:42:48.655491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b0e0f500-3fa8-4d1c-808d-d780e0af8d1d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:48.656101 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b0e0f500-3fa8-4d1c-808d-d780e0af8d1d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:48.662142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b0e0f500-3fa8-4d1c-808d-d780e0af8d1d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:48.662584 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b0e0f500-3fa8-4d1c-808d-d780e0af8d1d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:48.663346 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b0e0f500-3fa8-4d1c-808d-d780e0af8d1d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:48.664305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b0e0f500-3fa8-4d1c-808d-d780e0af8d1d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:48.796203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b0e0f500-3fa8-4d1c-808d-d780e0af8d1d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:48.803563 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b0e0f500-3fa8-4d1c-808d-d780e0af8d1d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.152025 Jun 17 07:42:48.804129 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 393/800] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:48 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:48.831909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3b722939-13f7-4f2b-aafb-e549ef68b069 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:48.832592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3b722939-13f7-4f2b-aafb-e549ef68b069 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:48.840116 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b722939-13f7-4f2b-aafb-e549ef68b069 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:48.840555 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b722939-13f7-4f2b-aafb-e549ef68b069 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:48.841303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b722939-13f7-4f2b-aafb-e549ef68b069 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:48.841754 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b722939-13f7-4f2b-aafb-e549ef68b069 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:48.974203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3b722939-13f7-4f2b-aafb-e549ef68b069 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:48.982061 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3b722939-13f7-4f2b-aafb-e549ef68b069 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1690 microversion: 2.1 time: 0.154190 Jun 17 07:42:48.982629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 408/801] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:48 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:49.415176 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:49.415785 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:49.422315 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:49.422770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:49.423545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:49.423982 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:49.556764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:49.565008 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:49.566575 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:49.567699 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4bd8c057-5fec-4d97-a5b7-f361a1463fca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.156524 Jun 17 07:42:49.568260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 394/802] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:49 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:49.821663 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ca6a8e2a-e6df-46aa-a47a-f762510438e6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:49.822457 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ca6a8e2a-e6df-46aa-a47a-f762510438e6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:49.824684 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:49.829772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ca6a8e2a-e6df-46aa-a47a-f762510438e6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:49.830213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ca6a8e2a-e6df-46aa-a47a-f762510438e6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:49.831060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ca6a8e2a-e6df-46aa-a47a-f762510438e6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:49.831488 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ca6a8e2a-e6df-46aa-a47a-f762510438e6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:49.961926 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ca6a8e2a-e6df-46aa-a47a-f762510438e6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:49.969293 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ca6a8e2a-e6df-46aa-a47a-f762510438e6 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.151901 Jun 17 07:42:49.969867 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 409/803] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:49 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:49.999268 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b139473c-bb23-4013-9b09-2f9ce81bfbe2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:49.999891 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b139473c-bb23-4013-9b09-2f9ce81bfbe2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:50.005813 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b139473c-bb23-4013-9b09-2f9ce81bfbe2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:50.006260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b139473c-bb23-4013-9b09-2f9ce81bfbe2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:50.007019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b139473c-bb23-4013-9b09-2f9ce81bfbe2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:50.007567 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b139473c-bb23-4013-9b09-2f9ce81bfbe2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:50.145409 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b139473c-bb23-4013-9b09-2f9ce81bfbe2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:50.153484 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b139473c-bb23-4013-9b09-2f9ce81bfbe2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1690 microversion: 2.1 time: 0.157939 Jun 17 07:42:50.154133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 395/804] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:49 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:50.586428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:50.587068 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:50.593598 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:50.594046 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:50.594847 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:50.595281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:50.737827 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:50.747122 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:50.748574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:50.749805 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b50e28dd-9e70-4059-a5ea-0270ea1b3b30 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.167771 Jun 17 07:42:50.750370 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 410/805] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:50 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:50.987264 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cecace11-23be-45fc-9128-29d4a5a1d59e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:50.987872 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cecace11-23be-45fc-9128-29d4a5a1d59e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:50.995094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cecace11-23be-45fc-9128-29d4a5a1d59e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:50.995540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cecace11-23be-45fc-9128-29d4a5a1d59e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:50.996295 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cecace11-23be-45fc-9128-29d4a5a1d59e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:50.996730 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cecace11-23be-45fc-9128-29d4a5a1d59e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:51.140085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cecace11-23be-45fc-9128-29d4a5a1d59e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:51.140085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cecace11-23be-45fc-9128-29d4a5a1d59e tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.151715 Jun 17 07:42:51.140085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 396/806] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:50 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:51.170727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b5459acd-00fa-4806-9311-98ab44e08e02 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:51.171333 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b5459acd-00fa-4806-9311-98ab44e08e02 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:51.173591 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:51.174252 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:51.179096 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b5459acd-00fa-4806-9311-98ab44e08e02 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:51.180185 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b5459acd-00fa-4806-9311-98ab44e08e02 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:51.180941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b5459acd-00fa-4806-9311-98ab44e08e02 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:51.181437 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b5459acd-00fa-4806-9311-98ab44e08e02 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:51.311726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b5459acd-00fa-4806-9311-98ab44e08e02 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:51.319275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b5459acd-00fa-4806-9311-98ab44e08e02 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1690 microversion: 2.1 time: 0.152406 Jun 17 07:42:51.319831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 411/807] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:51 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:51.768213 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:51.768796 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:51.770661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=6 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:51.775597 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:51.779306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:51.779306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:51.779306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:51.910318 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:51.920381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:51.921905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:51.923005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-88447526-f120-4567-9c45-054f475348ef tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.158835 Jun 17 07:42:51.923552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 397/808] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:51 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:42:52.151876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fbe505ae-0c8f-4ca5-9397-dbec819b9c0c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:52.155311 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fbe505ae-0c8f-4ca5-9397-dbec819b9c0c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:52.159121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fbe505ae-0c8f-4ca5-9397-dbec819b9c0c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:52.159558 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fbe505ae-0c8f-4ca5-9397-dbec819b9c0c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:52.160309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fbe505ae-0c8f-4ca5-9397-dbec819b9c0c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:52.160738 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fbe505ae-0c8f-4ca5-9397-dbec819b9c0c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:52.298459 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fbe505ae-0c8f-4ca5-9397-dbec819b9c0c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:52.305800 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fbe505ae-0c8f-4ca5-9397-dbec819b9c0c tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.158373 Jun 17 07:42:52.306352 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 412/809] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:52 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:52.337706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7837d726-0215-4639-b60e-063bfc2a5406 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:52.338308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7837d726-0215-4639-b60e-063bfc2a5406 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:52.344709 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7837d726-0215-4639-b60e-063bfc2a5406 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:52.345155 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7837d726-0215-4639-b60e-063bfc2a5406 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:52.345942 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7837d726-0215-4639-b60e-063bfc2a5406 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:52.346371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7837d726-0215-4639-b60e-063bfc2a5406 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:52.478644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7837d726-0215-4639-b60e-063bfc2a5406 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:52.486485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7837d726-0215-4639-b60e-063bfc2a5406 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1690 microversion: 2.1 time: 0.153270 Jun 17 07:42:52.487069 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 398/810] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:52 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:52.941567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:52.942210 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:52.949480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:52.949923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:52.950677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:52.951190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:53.083288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:53.086949 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:53.092363 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:53.107476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:53.107476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5498b68e-f48d-472c-966f-daada6c70925 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.158016 Jun 17 07:42:53.107476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 413/811] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:52 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:53.322704 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d0de82d5-6132-4386-9519-a96a7773375b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:53.323219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d0de82d5-6132-4386-9519-a96a7773375b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:53.329069 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d0de82d5-6132-4386-9519-a96a7773375b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:53.329547 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d0de82d5-6132-4386-9519-a96a7773375b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:53.330292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d0de82d5-6132-4386-9519-a96a7773375b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:53.330723 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d0de82d5-6132-4386-9519-a96a7773375b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:53.464022 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d0de82d5-6132-4386-9519-a96a7773375b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:53.471525 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d0de82d5-6132-4386-9519-a96a7773375b tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.152839 Jun 17 07:42:53.472090 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 399/812] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:53 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:53.503645 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-117949ae-068b-4406-871b-71d963e14f42 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:53.504246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-117949ae-068b-4406-871b-71d963e14f42 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:53.511030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-117949ae-068b-4406-871b-71d963e14f42 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:53.511470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-117949ae-068b-4406-871b-71d963e14f42 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:53.512215 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-117949ae-068b-4406-871b-71d963e14f42 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:53.512643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-117949ae-068b-4406-871b-71d963e14f42 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:53.640700 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-117949ae-068b-4406-871b-71d963e14f42 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:53.648135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-117949ae-068b-4406-871b-71d963e14f42 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1690 microversion: 2.1 time: 0.148580 Jun 17 07:42:53.648693 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 414/813] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:53 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:54.117140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:54.117140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:54.123006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:54.123455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:54.124238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:54.124729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:54.489704 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f73367df-317c-4553-8ab5-db5c24f99945 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:54.490563 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f73367df-317c-4553-8ab5-db5c24f99945 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:54.498270 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f73367df-317c-4553-8ab5-db5c24f99945 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:54.498943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f73367df-317c-4553-8ab5-db5c24f99945 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:54.500115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f73367df-317c-4553-8ab5-db5c24f99945 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:54.500469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f73367df-317c-4553-8ab5-db5c24f99945 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:54.508405 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:54.522774 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:54.526693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:54.528854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bafd1198-21ec-4b1c-83de-d6b61f2f404d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.417496 Jun 17 07:42:54.530376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 400/814] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:54 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:54.652911 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f73367df-317c-4553-8ab5-db5c24f99945 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:54.667735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7f2085bc-2dae-422b-8b48-e2adb33737c6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:54.668663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7f2085bc-2dae-422b-8b48-e2adb33737c6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:54.677103 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f73367df-317c-4553-8ab5-db5c24f99945 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1576 microversion: 2.1 time: 0.191262 Jun 17 07:42:54.678198 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 415/815] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:54 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:54.679969 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7f2085bc-2dae-422b-8b48-e2adb33737c6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:54.681359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7f2085bc-2dae-422b-8b48-e2adb33737c6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:54.682545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7f2085bc-2dae-422b-8b48-e2adb33737c6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:54.683145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7f2085bc-2dae-422b-8b48-e2adb33737c6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:54.780415 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7f2085bc-2dae-422b-8b48-e2adb33737c6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:54.787875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7f2085bc-2dae-422b-8b48-e2adb33737c6 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1622 microversion: 2.1 time: 0.125513 Jun 17 07:42:54.788514 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 401/816] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:54 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1622 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:42:55.007346 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-71bedac3-3cb0-4a8d-abe0-d030b6f418c0 req-c27bc898-4874-4ffa-8e5e-36042ce3ed19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1866c92-f2f4-49e4-b391-ffca4b0ce35b", "name": "network-vif-deleted", "tag": "1cbd5884-4ecf-4e5b-8a71-19880b70a371"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:55.016341 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-71bedac3-3cb0-4a8d-abe0-d030b6f418c0 req-c27bc898-4874-4ffa-8e5e-36042ce3ed19 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:55.016792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-71bedac3-3cb0-4a8d-abe0-d030b6f418c0 req-c27bc898-4874-4ffa-8e5e-36042ce3ed19 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:55.028593 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-71bedac3-3cb0-4a8d-abe0-d030b6f418c0 req-c27bc898-4874-4ffa-8e5e-36042ce3ed19 service nova] Creating event network-vif-deleted:1cbd5884-4ecf-4e5b-8a71-19880b70a371 for instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b on hv-cinder-79733 Jun 17 07:42:55.033549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-71bedac3-3cb0-4a8d-abe0-d030b6f418c0 req-c27bc898-4874-4ffa-8e5e-36042ce3ed19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029860 Jun 17 07:42:55.034235 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 416/817] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:42:55.548260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:55.549595 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:55.557144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:55.557775 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:55.558721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:55.559233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:55.697309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1fb6bf61-b138-4714-9f6e-c815caf693cd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:55.699065 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:55.699294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1fb6bf61-b138-4714-9f6e-c815caf693cd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:55.705901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1fb6bf61-b138-4714-9f6e-c815caf693cd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:55.706350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1fb6bf61-b138-4714-9f6e-c815caf693cd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:55.707130 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1fb6bf61-b138-4714-9f6e-c815caf693cd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:55.707568 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1fb6bf61-b138-4714-9f6e-c815caf693cd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:55.708671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:55.710350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:55.712223 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cb2022f1-edbe-4595-b485-e405b81b7ba6 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.168164 Jun 17 07:42:55.712878 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 402/818] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:55 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:55.804714 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:55.805214 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:55.812161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:55.812604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:55.813481 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:55.813831 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:55.847250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:55.847693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:55.848138 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lazy-loading 'fault' on Instance uuid c1866c92-f2f4-49e4-b391-ffca4b0ce35b {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:42:55.873084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1fb6bf61-b138-4714-9f6e-c815caf693cd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:55.881227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1fb6bf61-b138-4714-9f6e-c815caf693cd tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1563 microversion: 2.1 time: 0.188993 Jun 17 07:42:55.882065 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 417/819] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:55 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:55.904836 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:55.912737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-51b5288e-7f04-4297-a539-3e6462f3e61d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 200 len: 1335 microversion: 2.1 time: 0.111943 Jun 17 07:42:55.913355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 403/820] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:55 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:42:56.730619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:56.731306 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:56.738677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:56.739196 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:56.740000 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:56.740540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:56.838506 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-cc91441c-f405-4f57-adfc-45dfde87dde1 req-08efe2da-50e2-4c53-9cfe-010e321870c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871cb913-ba89-4924-8a2c-ad61a797c36b", "name": "network-vif-plugged", "status": "completed", "tag": "801e37b2-c880-4c3a-a5bd-cdf86430b915"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:42:56.842692 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:42:56.848792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-cc91441c-f405-4f57-adfc-45dfde87dde1 req-08efe2da-50e2-4c53-9cfe-010e321870c7 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:56.849241 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-cc91441c-f405-4f57-adfc-45dfde87dde1 req-08efe2da-50e2-4c53-9cfe-010e321870c7 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:56.861391 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-cc91441c-f405-4f57-adfc-45dfde87dde1 req-08efe2da-50e2-4c53-9cfe-010e321870c7 service nova] Creating event network-vif-plugged:801e37b2-c880-4c3a-a5bd-cdf86430b915 for instance 871cb913-ba89-4924-8a2c-ad61a797c36b on hv-cinder-79733 Jun 17 07:42:56.866530 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-cc91441c-f405-4f57-adfc-45dfde87dde1 req-08efe2da-50e2-4c53-9cfe-010e321870c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Jun 17 07:42:56.867148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 404/821] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:42:56.882247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:56.891445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:56.892936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:56.894096 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-17541d7c-56dd-4ce5-844a-d40b864b4114 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.167841 Jun 17 07:42:56.895555 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 418/822] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:56 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:56.931415 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:56.932455 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: c1866c92-f2f4-49e4-b391-ffca4b0ce35b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:56.938882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:56.939273 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:56.940050 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:56.940519 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:56.958870 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] HTTP exception thrown: Instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b could not be found. Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Request method failure captured: Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b HTTP/1.1 Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC6HgW97DcVVe4zZ61jVJs6vqC6qVhgTTgpRZLuuUIvCMGWPsPvHURwju_GWPhbE2FTMvDkaV4jYSRQjzbnalfB7fA37jYPdA7b1XT9pj7nR03MzhEo5E5WEws7RJM_5lbiJWwsFyGl9Ass_D1fQkk_YzJmiXWio0Cd4ALAcqfvz0Hk Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:42:56.960531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 8b753148f55e4fb0897bf9639e8d4d70 Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b could not be found. Jun 17 07:42:56.963676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'c1866c92-f2f4-49e4-b391-ffca4b0ce35b'} Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b could not be found. Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:42:56.964875 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b could not be found. Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b could not be found. Jun 17 07:42:56.966466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:42:56.967769 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Returning 404 to user: Instance c1866c92-f2f4-49e4-b391-ffca4b0ce35b could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:42:56.967769 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-69664287-40bb-4f8f-b2d2-97cda822817b tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b" status: 404 len: 111 microversion: 2.1 time: 0.035048 Jun 17 07:42:56.967769 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 405/823] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:42:56 2022] GET /compute/v2.1/servers/c1866c92-f2f4-49e4-b391-ffca4b0ce35b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:42:56.972102 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-28e88c2f-8e01-4c4f-90c3-e06d70ff7168 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '.version_select at 0x7fb069b8f4c0>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:57.054247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-28e88c2f-8e01-4c4f-90c3-e06d70ff7168 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433800131" status: 202 len: 0 microversion: 2.1 time: 0.086225 Jun 17 07:42:57.055114 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 419/824] 10.222.0.52 () {58 vars in 1220 bytes} [Fri Jun 17 07:42:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433800131 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:42:57.913860 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:57.914467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:57.922050 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:57.922502 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:57.923256 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:57.923694 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:58.062758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:58.071252 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:58.072846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:58.074373 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3a215dfc-23b5-4eee-9109-3e8cc8e74ea4 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.164508 Jun 17 07:42:58.074574 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 406/825] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:57 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:42:59.092683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:42:59.093338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:42:59.099289 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:59.099730 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:59.100472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:42:59.100901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:42:59.232809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:59.241105 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:59.242671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:42:59.246844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-66d73dc0-06a9-4690-91ab-ae9d9fbe8f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1406 microversion: 2.20 time: 0.155575 Jun 17 07:42:59.246844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 420/826] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:42:59 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:43:00.264446 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:00.265089 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:00.271883 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:00.272373 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:00.273185 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:00.273675 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:00.402684 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:00.410856 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:00.412353 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:00.413558 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0f3aee89-7650-4e97-b353-7db0a027e6e3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1598 microversion: 2.20 time: 0.154197 Jun 17 07:43:00.414107 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 407/827] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:43:00 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:43:00.431046 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fbd02697-4f65-4a15-b3ae-f90dd987841f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:00.432144 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fbd02697-4f65-4a15-b3ae-f90dd987841f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:00.438780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fbd02697-4f65-4a15-b3ae-f90dd987841f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:00.439234 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fbd02697-4f65-4a15-b3ae-f90dd987841f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:00.440014 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fbd02697-4f65-4a15-b3ae-f90dd987841f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:00.440506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fbd02697-4f65-4a15-b3ae-f90dd987841f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:00.523702 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fbd02697-4f65-4a15-b3ae-f90dd987841f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096518 Jun 17 07:43:00.524301 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 421/828] 10.222.0.52 () {60 vars in 1315 bytes} [Fri Jun 17 07:43:00 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:43:00.566604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-18ffb689-3231-4ab0-8fa0-20f54615914d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:00.567219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-18ffb689-3231-4ab0-8fa0-20f54615914d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:00.574121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-18ffb689-3231-4ab0-8fa0-20f54615914d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:00.574645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-18ffb689-3231-4ab0-8fa0-20f54615914d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:00.575498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-18ffb689-3231-4ab0-8fa0-20f54615914d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:00.576006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-18ffb689-3231-4ab0-8fa0-20f54615914d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:00.600685 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-18ffb689-3231-4ab0-8fa0-20f54615914d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:43:00.604341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:00.921435 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-18ffb689-3231-4ab0-8fa0-20f54615914d tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "DELETE /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 204 len: 0 microversion: 2.1 time: 0.358306 Jun 17 07:43:00.922106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 408/829] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:43:00 2022] DELETE /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:43:00.930129 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-389eb7a4-f802-46f7-abec-d4f29a1e2767 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:00.930743 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-389eb7a4-f802-46f7-abec-d4f29a1e2767 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:00.941549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-389eb7a4-f802-46f7-abec-d4f29a1e2767 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:00.941549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-389eb7a4-f802-46f7-abec-d4f29a1e2767 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:00.941549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-389eb7a4-f802-46f7-abec-d4f29a1e2767 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:00.941549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-389eb7a4-f802-46f7-abec-d4f29a1e2767 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:01.105095 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-389eb7a4-f802-46f7-abec-d4f29a1e2767 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:01.112250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-389eb7a4-f802-46f7-abec-d4f29a1e2767 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1507 microversion: 2.1 time: 0.185914 Jun 17 07:43:01.113040 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 422/830] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:00 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:01.562545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-c3a03ec0-fae0-4304-a639-84d2ad78d35a req-848ba160-6f4c-4729-98de-4b6678e18bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871cb913-ba89-4924-8a2c-ad61a797c36b", "tag": "801e37b2-c880-4c3a-a5bd-cdf86430b915"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:01.571113 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-c3a03ec0-fae0-4304-a639-84d2ad78d35a req-848ba160-6f4c-4729-98de-4b6678e18bb3 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:01.571622 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-c3a03ec0-fae0-4304-a639-84d2ad78d35a req-848ba160-6f4c-4729-98de-4b6678e18bb3 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:01.583195 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-c3a03ec0-fae0-4304-a639-84d2ad78d35a req-848ba160-6f4c-4729-98de-4b6678e18bb3 service nova] Creating event network-changed:801e37b2-c880-4c3a-a5bd-cdf86430b915 for instance 871cb913-ba89-4924-8a2c-ad61a797c36b on hv-cinder-79733 Jun 17 07:43:01.588687 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-c3a03ec0-fae0-4304-a639-84d2ad78d35a req-848ba160-6f4c-4729-98de-4b6678e18bb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029986 Jun 17 07:43:01.589281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 409/831] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:02.130220 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-adffcfd5-9069-44c8-8c28-44de39730aae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:02.130908 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-adffcfd5-9069-44c8-8c28-44de39730aae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:02.138830 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-adffcfd5-9069-44c8-8c28-44de39730aae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:02.139602 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-adffcfd5-9069-44c8-8c28-44de39730aae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:02.140543 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-adffcfd5-9069-44c8-8c28-44de39730aae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:02.141200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-adffcfd5-9069-44c8-8c28-44de39730aae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:02.388623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-bd1ac2f4-3ce3-4ccd-9f05-6c7e91e557de req-9b825e17-d6a6-43f4-af75-933507d5e822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "890073f7-7e31-4a66-85bf-99292054e64f", "name": "network-vif-deleted", "tag": "20c496e9-41d6-48b1-8faf-5a524259d80b"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:02.399857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-bd1ac2f4-3ce3-4ccd-9f05-6c7e91e557de req-9b825e17-d6a6-43f4-af75-933507d5e822 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:02.400473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-bd1ac2f4-3ce3-4ccd-9f05-6c7e91e557de req-9b825e17-d6a6-43f4-af75-933507d5e822 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:02.418588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-bd1ac2f4-3ce3-4ccd-9f05-6c7e91e557de req-9b825e17-d6a6-43f4-af75-933507d5e822 service nova] Creating event network-vif-deleted:20c496e9-41d6-48b1-8faf-5a524259d80b for instance 890073f7-7e31-4a66-85bf-99292054e64f on hv-cinder-79733 Jun 17 07:43:02.425594 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-adffcfd5-9069-44c8-8c28-44de39730aae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:02.425825 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-bd1ac2f4-3ce3-4ccd-9f05-6c7e91e557de req-9b825e17-d6a6-43f4-af75-933507d5e822 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044373 Jun 17 07:43:02.426670 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 410/832] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:02.436519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-adffcfd5-9069-44c8-8c28-44de39730aae tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1507 microversion: 2.1 time: 0.310357 Jun 17 07:43:02.437908 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 423/833] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:02 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:03.455607 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:03.456326 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:03.464615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:03.465059 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:03.465859 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:03.466293 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:03.500341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:03.500789 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:03.501242 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lazy-loading 'fault' on Instance uuid 890073f7-7e31-4a66-85bf-99292054e64f {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:43:03.544035 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:03.551877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c26e524b-f417-40b1-88b2-2274e61f58c4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 200 len: 1312 microversion: 2.1 time: 0.100962 Jun 17 07:43:03.552383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 411/834] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:03 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:43:04.569729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:04.570370 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: 890073f7-7e31-4a66-85bf-99292054e64f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:04.576790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:04.577246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:04.578096 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:04.578533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:04.592101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] HTTP exception thrown: Instance 890073f7-7e31-4a66-85bf-99292054e64f could not be found. Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Request method failure captured: Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f HTTP/1.1 Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6HgW97DcVVe4zZ61jVJs6vqC6qVhgTTgpRZLuuUIvCMGWPsPvHURwju_GWPhbE2FTMvDkaV4jYSRQjzbnalfB7fA37jYPdA7b1XT9pj7nR03MzhEo5E5WEws7RJM_5lbiJWwsFyGl9Ass_D1fQkk_YzJmiXWio0Cd4ALAcqfvz0Hk Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:43:04.593772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 8b753148f55e4fb0897bf9639e8d4d70 Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 890073f7-7e31-4a66-85bf-99292054e64f could not be found. Jun 17 07:43:04.595200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '890073f7-7e31-4a66-85bf-99292054e64f'} Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890073f7-7e31-4a66-85bf-99292054e64f could not be found. Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:43:04.595920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890073f7-7e31-4a66-85bf-99292054e64f could not be found. Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890073f7-7e31-4a66-85bf-99292054e64f could not be found. Jun 17 07:43:04.597682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:04.599139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Returning 404 to user: Instance 890073f7-7e31-4a66-85bf-99292054e64f could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:43:04.599139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-96dff217-545a-496f-b4c7-a63bc1755cbd tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f" status: 404 len: 111 microversion: 2.1 time: 0.029464 Jun 17 07:43:04.599139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 424/835] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:04 2022] GET /compute/v2.1/servers/890073f7-7e31-4a66-85bf-99292054e64f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:43:04.604329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-98da8594-94d0-474e-a4e3-218379646f23 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:04.604853 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-98da8594-94d0-474e-a4e3-218379646f23 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:04.611331 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-98da8594-94d0-474e-a4e3-218379646f23 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:04.611774 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-98da8594-94d0-474e-a4e3-218379646f23 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:04.612529 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-98da8594-94d0-474e-a4e3-218379646f23 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:04.612965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-98da8594-94d0-474e-a4e3-218379646f23 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:04.636848 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-98da8594-94d0-474e-a4e3-218379646f23 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:43:04.909876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-98da8594-94d0-474e-a4e3-218379646f23 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 204 len: 0 microversion: 2.1 time: 0.309674 Jun 17 07:43:04.910472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 412/836] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:43:04 2022] DELETE /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:43:04.919060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e97dfaea-77ae-483b-9469-97ca211407a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:04.919833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e97dfaea-77ae-483b-9469-97ca211407a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:04.926449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e97dfaea-77ae-483b-9469-97ca211407a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:04.926889 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e97dfaea-77ae-483b-9469-97ca211407a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:04.927639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e97dfaea-77ae-483b-9469-97ca211407a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:04.928074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e97dfaea-77ae-483b-9469-97ca211407a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:05.061283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e97dfaea-77ae-483b-9469-97ca211407a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:05.068681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e97dfaea-77ae-483b-9469-97ca211407a4 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.154156 Jun 17 07:43:05.069237 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 425/837] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:04 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:06.087450 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b8b7e8f3-b6e2-4fd2-9a14-0e0c2b0fad2e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:06.088336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b8b7e8f3-b6e2-4fd2-9a14-0e0c2b0fad2e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:06.095166 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b8b7e8f3-b6e2-4fd2-9a14-0e0c2b0fad2e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:06.095610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b8b7e8f3-b6e2-4fd2-9a14-0e0c2b0fad2e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:06.096402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b8b7e8f3-b6e2-4fd2-9a14-0e0c2b0fad2e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:06.096832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b8b7e8f3-b6e2-4fd2-9a14-0e0c2b0fad2e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:06.230151 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b8b7e8f3-b6e2-4fd2-9a14-0e0c2b0fad2e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:06.237938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b8b7e8f3-b6e2-4fd2-9a14-0e0c2b0fad2e tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1522 microversion: 2.1 time: 0.155062 Jun 17 07:43:06.238502 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 413/838] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:06 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:06.420795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-5bf9337c-3599-43ed-8a9b-5f515c736718 req-e7010840-b99d-40e5-a1e4-b46082630e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5abf359-6883-489c-b6bc-d6456efc857d", "name": "network-vif-deleted", "tag": "d8ca212b-ae6d-40b5-8948-4d106f1e7165"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:06.429464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-5bf9337c-3599-43ed-8a9b-5f515c736718 req-e7010840-b99d-40e5-a1e4-b46082630e79 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:06.429906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-5bf9337c-3599-43ed-8a9b-5f515c736718 req-e7010840-b99d-40e5-a1e4-b46082630e79 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:06.442604 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-5bf9337c-3599-43ed-8a9b-5f515c736718 req-e7010840-b99d-40e5-a1e4-b46082630e79 service nova] Creating event network-vif-deleted:d8ca212b-ae6d-40b5-8948-4d106f1e7165 for instance e5abf359-6883-489c-b6bc-d6456efc857d on hv-cinder-79733 Jun 17 07:43:06.448279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-5bf9337c-3599-43ed-8a9b-5f515c736718 req-e7010840-b99d-40e5-a1e4-b46082630e79 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031201 Jun 17 07:43:06.448903 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 426/839] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:07.255294 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:07.255906 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:07.262487 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:07.262938 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:07.263703 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:07.264141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:07.294860 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:07.295310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:07.295771 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lazy-loading 'fault' on Instance uuid e5abf359-6883-489c-b6bc-d6456efc857d {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:43:07.340582 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b753148f55e4fb0897bf9639e8d4d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fc753fb51e41acb3037d2ca7cd1394', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:07.348732 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-03ecc902-dbd6-45de-861b-17a13f0653b2 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 200 len: 1312 microversion: 2.1 time: 0.097305 Jun 17 07:43:07.349382 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 414/840] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:07 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:08.367791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:08.369060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] [instance: e5abf359-6883-489c-b6bc-d6456efc857d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:08.375221 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:08.375670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:08.376458 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:08.376898 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:08.391212 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] HTTP exception thrown: Instance e5abf359-6883-489c-b6bc-d6456efc857d could not be found. Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Request method failure captured: Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d HTTP/1.1 Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6HgW97DcVVe4zZ61jVJs6vqC6qVhgTTgpRZLuuUIvCMGWPsPvHURwju_GWPhbE2FTMvDkaV4jYSRQjzbnalfB7fA37jYPdA7b1XT9pj7nR03MzhEo5E5WEws7RJM_5lbiJWwsFyGl9Ass_D1fQkk_YzJmiXWio0Cd4ALAcqfvz0Hk Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:43:08.392747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/94fc753fb51e41acb3037d2ca7cd1394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 94fc753fb51e41acb3037d2ca7cd1394 Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-991827681 Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 8b753148f55e4fb0897bf9639e8d4d70 Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-ServerRescueNegativeTestJSON-991827681-project Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance e5abf359-6883-489c-b6bc-d6456efc857d could not be found. Jun 17 07:43:08.394296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'e5abf359-6883-489c-b6bc-d6456efc857d'} Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5abf359-6883-489c-b6bc-d6456efc857d could not be found. Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:43:08.395177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5abf359-6883-489c-b6bc-d6456efc857d could not be found. Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5abf359-6883-489c-b6bc-d6456efc857d could not be found. Jun 17 07:43:08.396685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:43:08.398184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] Returning 404 to user: Instance e5abf359-6883-489c-b6bc-d6456efc857d could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:43:08.398184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b71f4e4b-ab19-40ba-9ced-31c1fbd99bb9 tempest-ServerRescueNegativeTestJSON-991827681 tempest-ServerRescueNegativeTestJSON-991827681-project] 10.222.0.52 "GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d" status: 404 len: 111 microversion: 2.1 time: 0.031062 Jun 17 07:43:08.398184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 427/841] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:08 2022] GET /compute/v2.1/servers/e5abf359-6883-489c-b6bc-d6456efc857d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:43:16.800486 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-558b226e-87a0-4e36-aa14-8047663cf0d2 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069bb83a0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:16.848978 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-558b226e-87a0-4e36-aa14-8047663cf0d2 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f1ea80eb-039e-4c8f-abc0-f028b573fd95" status: 200 len: 351 microversion: 2.1 time: 0.052248 Jun 17 07:43:16.849588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 415/842] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:43:16 2022] GET /compute/v2.1/os-volumes/f1ea80eb-039e-4c8f-abc0-f028b573fd95 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:19.594876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-991da6c0-c8e0-4d5d-a356-a4268796c00d tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069bb1f70>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:19.601574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:19.602293 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=60 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:19.644798 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-991da6c0-c8e0-4d5d-a356-a4268796c00d tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/03d23388-a1c3-4f14-a97c-40cfeb9024c6" status: 200 len: 350 microversion: 2.1 time: 0.053705 Jun 17 07:43:19.645414 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 428/843] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:43:19 2022] GET /compute/v2.1/os-volumes/03d23388-a1c3-4f14-a97c-40cfeb9024c6 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:22.310487 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:22.311244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:43:22.315674 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b0776292-d3f5-4ff3-b6e5-512fc73f04d5 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069c5f790>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:22.364701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b0776292-d3f5-4ff3-b6e5-512fc73f04d5 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6cb43199-08b3-4cd9-914a-c6e23c2f326a" status: 200 len: 351 microversion: 2.1 time: 0.054470 Jun 17 07:43:22.364823 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 416/844] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:43:22 2022] GET /compute/v2.1/os-volumes/6cb43199-08b3-4cd9-914a-c6e23c2f326a => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:22.377674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-83e2f9e6-f84e-43df-8814-bc822792ea2c tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb06c50c040>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:22.463684 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-83e2f9e6-f84e-43df-8814-bc822792ea2c tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090869 Jun 17 07:43:22.464245 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 429/845] 10.222.0.52 () {58 vars in 1133 bytes} [Fri Jun 17 07:43:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:22.476484 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dad3c9b9-4863-4eed-a18c-1f3bfe52de69 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069c5f3a0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:22.558453 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dad3c9b9-4863-4eed-a18c-1f3bfe52de69 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086004 Jun 17 07:43:22.559033 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 417/846] 10.222.0.52 () {58 vars in 1148 bytes} [Fri Jun 17 07:43:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:22.570864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0ce2ee22-9a25-43ed-b065-2822c9568c86 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069bb1940>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:22.654598 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0ce2ee22-9a25-43ed-b065-2822c9568c86 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087579 Jun 17 07:43:22.655169 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 430/847] 10.222.0.52 () {58 vars in 1133 bytes} [Fri Jun 17 07:43:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:43:22.667044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-61554595-7e58-4019-8343-9d2a6f4ff198 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069b67a60>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:22.751974 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-61554595-7e58-4019-8343-9d2a6f4ff198 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085387 Jun 17 07:43:22.751974 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 418/848] 10.222.0.52 () {58 vars in 1166 bytes} [Fri Jun 17 07:43:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:22.760842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f51945c7-4710-4865-a766-03ff98b5b0e5 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069bbee50>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:22.841763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f51945c7-4710-4865-a766-03ff98b5b0e5 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085276 Jun 17 07:43:22.847521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 431/849] 10.222.0.52 () {58 vars in 1169 bytes} [Fri Jun 17 07:43:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:22.855105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ed326efe-9e66-495b-9e4b-05e7f08436cd tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb06a106ee0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:22.937419 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ed326efe-9e66-495b-9e4b-05e7f08436cd tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086490 Jun 17 07:43:22.937997 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 419/850] 10.222.0.52 () {58 vars in 1154 bytes} [Fri Jun 17 07:43:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:22.949625 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-037831dd-da4e-4faf-9ea3-677220759de0 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069c85820>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:23.029890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-037831dd-da4e-4faf-9ea3-677220759de0 tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084395 Jun 17 07:43:23.030450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 432/851] 10.222.0.52 () {58 vars in 1187 bytes} [Fri Jun 17 07:43:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:23.043007 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fdb6d922-b41e-452c-9e90-b01c707d776b tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] Calling method '.version_select at 0x7fb069afd9d0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:23.125127 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fdb6d922-b41e-452c-9e90-b01c707d776b tempest-VolumesTestJSON-371177532 tempest-VolumesTestJSON-371177532-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086939 Jun 17 07:43:23.125735 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 420/852] 10.222.0.52 () {58 vars in 1154 bytes} [Fri Jun 17 07:43:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:43.425628 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2705ae23-8c58-4d8a-a86b-8f8c0ad72243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:43.426521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2705ae23-8c58-4d8a-a86b-8f8c0ad72243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:43.432495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2705ae23-8c58-4d8a-a86b-8f8c0ad72243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:43.432935 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2705ae23-8c58-4d8a-a86b-8f8c0ad72243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:43.433992 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2705ae23-8c58-4d8a-a86b-8f8c0ad72243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:43.434429 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2705ae23-8c58-4d8a-a86b-8f8c0ad72243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:43.463039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2705ae23-8c58-4d8a-a86b-8f8c0ad72243 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042137 Jun 17 07:43:43.463601 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 433/853] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:43:43 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:43:43.538249 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d7ab42a2-9c46-4a89-9337-412e39a48152 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:43.538844 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d7ab42a2-9c46-4a89-9337-412e39a48152 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:43.545652 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7ab42a2-9c46-4a89-9337-412e39a48152 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:43.546086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7ab42a2-9c46-4a89-9337-412e39a48152 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:43.546886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7ab42a2-9c46-4a89-9337-412e39a48152 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:43.547319 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d7ab42a2-9c46-4a89-9337-412e39a48152 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:43.573602 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d7ab42a2-9c46-4a89-9337-412e39a48152 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:43:43.885672 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d7ab42a2-9c46-4a89-9337-412e39a48152 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 204 len: 0 microversion: 2.1 time: 0.352090 Jun 17 07:43:43.886259 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 421/854] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:43:43 2022] DELETE /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:43:43.894926 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d6747193-7d3a-4580-99de-13a3e10e5fe5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:43.895523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d6747193-7d3a-4580-99de-13a3e10e5fe5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:43.901755 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d6747193-7d3a-4580-99de-13a3e10e5fe5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:43.902204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d6747193-7d3a-4580-99de-13a3e10e5fe5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:43.903519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d6747193-7d3a-4580-99de-13a3e10e5fe5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:43.903946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d6747193-7d3a-4580-99de-13a3e10e5fe5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:44.045253 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d6747193-7d3a-4580-99de-13a3e10e5fe5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:44.052978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d6747193-7d3a-4580-99de-13a3e10e5fe5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1674 microversion: 2.1 time: 0.161805 Jun 17 07:43:44.053577 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 434/855] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:43 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:45.071393 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d0547a94-bd29-42ee-842d-a1f99fd5bf30 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:45.072088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d0547a94-bd29-42ee-842d-a1f99fd5bf30 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:45.078763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d0547a94-bd29-42ee-842d-a1f99fd5bf30 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:45.079207 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d0547a94-bd29-42ee-842d-a1f99fd5bf30 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:45.079969 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d0547a94-bd29-42ee-842d-a1f99fd5bf30 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:45.080403 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d0547a94-bd29-42ee-842d-a1f99fd5bf30 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:45.229176 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d0547a94-bd29-42ee-842d-a1f99fd5bf30 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:45.237784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d0547a94-bd29-42ee-842d-a1f99fd5bf30 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1674 microversion: 2.1 time: 0.170623 Jun 17 07:43:45.238357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 422/856] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:45 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:46.259194 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8b68e1c0-2ec7-4e0e-924f-019d8949ef85 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:46.259800 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8b68e1c0-2ec7-4e0e-924f-019d8949ef85 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:46.267439 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8b68e1c0-2ec7-4e0e-924f-019d8949ef85 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:46.267880 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8b68e1c0-2ec7-4e0e-924f-019d8949ef85 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:46.268642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8b68e1c0-2ec7-4e0e-924f-019d8949ef85 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:46.269070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8b68e1c0-2ec7-4e0e-924f-019d8949ef85 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:46.462387 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8b68e1c0-2ec7-4e0e-924f-019d8949ef85 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:46.471750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8b68e1c0-2ec7-4e0e-924f-019d8949ef85 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1606 microversion: 2.1 time: 0.216455 Jun 17 07:43:46.472222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 435/857] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:46 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1606 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:46.701298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-0a48171a-fffb-4abc-aee0-3c7ed36ee9d4 req-8d6c2fa4-94cf-4cda-ae52-a58371d2c388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8444090b-ae6f-4602-a407-fbc601de5625", "name": "network-vif-deleted", "tag": "19c183bd-b52f-4034-8235-199f76f21ce8"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:46.712463 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-0a48171a-fffb-4abc-aee0-3c7ed36ee9d4 req-8d6c2fa4-94cf-4cda-ae52-a58371d2c388 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:46.712463 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-0a48171a-fffb-4abc-aee0-3c7ed36ee9d4 req-8d6c2fa4-94cf-4cda-ae52-a58371d2c388 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:46.725201 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-0a48171a-fffb-4abc-aee0-3c7ed36ee9d4 req-8d6c2fa4-94cf-4cda-ae52-a58371d2c388 service nova] Creating event network-vif-deleted:19c183bd-b52f-4034-8235-199f76f21ce8 for instance 8444090b-ae6f-4602-a407-fbc601de5625 on hv-cinder-79733 Jun 17 07:43:46.731706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-0a48171a-fffb-4abc-aee0-3c7ed36ee9d4 req-8d6c2fa4-94cf-4cda-ae52-a58371d2c388 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033630 Jun 17 07:43:46.732654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 423/858] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:47.489648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:47.491632 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:47.497874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:47.498329 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:47.499110 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:47.499556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:47.533084 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:47.533820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:47.534544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lazy-loading 'fault' on Instance uuid 8444090b-ae6f-4602-a407-fbc601de5625 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:43:47.600786 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:47.611179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3b9f9e12-800f-4725-9da7-b174ffa951c2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 200 len: 1327 microversion: 2.1 time: 0.125309 Jun 17 07:43:47.612050 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 436/859] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:47 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:48.629295 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:48.630015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:48.639956 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:48.640410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:48.641182 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:48.641655 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:48.656919 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] HTTP exception thrown: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Request method failure captured: Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 HTTP/1.1 Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC75XtkH2fnRLdanT-GjQwYrtlkv7qpmYzvSPD8m1tBdZMjDLTsTUxoltYmV70_nUcbK3y8Exwl9jTthcQpodwn_7_UXRexrfKCuCipt7OryNLG_Sa7kkyZ5rBf5ZffyazjG66IV9911a8EPrceSBOJlESDkrXE8DTtzGcSyzx6t6nE Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:43:48.658624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: c9c07cf08d9c45479f9530efe9dcad2a Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:43:48.659955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '8444090b-ae6f-4602-a407-fbc601de5625'} Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:43:48.661406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:43:48.662827 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:43:48.665222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Returning 404 to user: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:43:48.665222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7687dbe0-3ed8-4384-8b07-a89107790e3f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 404 len: 111 microversion: 2.1 time: 0.035485 Jun 17 07:43:48.665222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 424/860] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:48 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:43:48.669982 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b754529b-5ed3-4f05-97f0-48b264e57bcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '.version_select at 0x7fb069b8fd30>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:48.769173 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b754529b-5ed3-4f05-97f0-48b264e57bcc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-150197160" status: 202 len: 0 microversion: 2.1 time: 0.103819 Jun 17 07:43:48.769812 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 437/861] 10.222.0.52 () {58 vars in 1217 bytes} [Fri Jun 17 07:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-150197160 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:43:49.619187 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-80211994-7ca0-4b78-bc16-317dae581204 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'create', calling method: .version_select at 0x7fb069c588b0>, body: {"keypair": {"name": "tempest-keypair-888151330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB6DTvFpGCMxgmhK6wq6TPU4aLWaMJzpdsxqbJOc2uT1i6IknXVGld+rx/7kSEyms13y/8zkpNHdD0b/nurFpyAa4u15OcQguLXp/VpOKCb7/9PacI5mSwpyC3SEHyv/A=="}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:49.636535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-80211994-7ca0-4b78-bc16-317dae581204 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Getting quotas for project ae461627578a489a9a6a9569cee15eb8. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:43:49.641540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-80211994-7ca0-4b78-bc16-317dae581204 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Getting quotas for user c9c07cf08d9c45479f9530efe9dcad2a and project ae461627578a489a9a6a9569cee15eb8. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:43:49.726618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-80211994-7ca0-4b78-bc16-317dae581204 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111365 Jun 17 07:43:49.727480 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 425/862] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:43:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:52.084120 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1295126360", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d39f224e-8e41-41d1-b926-98d1d555c539"}], "security_groups": [{"name": "tempest-securitygroup--57116595"}], "key_name": "tempest-keypair-888151330", "user_data": "}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:52.190222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] validate_networks() for [('d39f224e-8e41-41d1-b926-98d1d555c539', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:43:52.572660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:43:52.572660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:43:52.572660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:43:52.572660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:43:52.572660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:43:52.581228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:52.581704 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:52.582489 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:52.582924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:52.600246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Getting quotas for project ae461627578a489a9a6a9569cee15eb8. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:43:52.604292 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Getting quotas for user c9c07cf08d9c45479f9530efe9dcad2a and project ae461627578a489a9a6a9569cee15eb8. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:43:52.615654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:43:52.617945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:43:52.755338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c182837e-c789-4602-a2d7-49dcba7f638f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.676024 Jun 17 07:43:52.755987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 438/863] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:43:52 2022] POST /compute/v2.1/servers => generated 400 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:43:52.766597 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0ecfc953-126b-4dd4-a97a-639c12c189ef tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:52.767212 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0ecfc953-126b-4dd4-a97a-639c12c189ef tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:52.861693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0ecfc953-126b-4dd4-a97a-639c12c189ef tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:52.861693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0ecfc953-126b-4dd4-a97a-639c12c189ef tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1237 microversion: 2.1 time: 0.085480 Jun 17 07:43:52.861693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 426/864] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:52 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:53.551846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-682247973", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "networks": [{"uuid": "46e5867d-8690-4d3c-b1a3-8d804e630659"}]}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:53.604077 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] validate_networks() for [('46e5867d-8690-4d3c-b1a3-8d804e630659', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:43:53.876599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e9a4abac-1a65-4dfc-abac-cbeccd00f29a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:53.877218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e9a4abac-1a65-4dfc-abac-cbeccd00f29a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:53.884185 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e9a4abac-1a65-4dfc-abac-cbeccd00f29a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:53.884917 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e9a4abac-1a65-4dfc-abac-cbeccd00f29a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:53.885733 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e9a4abac-1a65-4dfc-abac-cbeccd00f29a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:53.886170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e9a4abac-1a65-4dfc-abac-cbeccd00f29a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:53.952690 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e9a4abac-1a65-4dfc-abac-cbeccd00f29a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:53.960891 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e9a4abac-1a65-4dfc-abac-cbeccd00f29a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1241 microversion: 2.1 time: 0.088039 Jun 17 07:43:53.961501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 427/865] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:53 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:43:53.972059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:43:53.972059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:43:53.972059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:43:53.972059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:43:53.972743 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:43:53.983549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:53.984003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:53.984804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:53.985246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:54.003859 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Getting quotas for project 5fe594d24d9843acbec2e846c98c14ae. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:43:54.007760 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Getting quotas for user 8be176511fa34aa6aa5fe83bc6a2b163 and project 5fe594d24d9843acbec2e846c98c14ae. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:43:54.020327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:43:54.022508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:43:54.161456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a6a5b7b6-c158-4a2d-9cfa-582abf8713c0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613935 Jun 17 07:43:54.162118 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 439/866] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:43:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:43:54.172706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fd08de2f-d39e-437e-a572-28f15370cf67 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:54.173355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fd08de2f-d39e-437e-a572-28f15370cf67 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:54.234227 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fd08de2f-d39e-437e-a572-28f15370cf67 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:54.242292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fd08de2f-d39e-437e-a572-28f15370cf67 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1213 microversion: 2.1 time: 0.073923 Jun 17 07:43:54.243742 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 428/867] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:54 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:54.978739 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-38452c05-4f95-4c98-8af1-73508346b192 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:54.979347 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-38452c05-4f95-4c98-8af1-73508346b192 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:54.986758 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38452c05-4f95-4c98-8af1-73508346b192 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:54.987261 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38452c05-4f95-4c98-8af1-73508346b192 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:54.988017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38452c05-4f95-4c98-8af1-73508346b192 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:54.988664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-38452c05-4f95-4c98-8af1-73508346b192 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:55.071167 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-38452c05-4f95-4c98-8af1-73508346b192 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:55.079770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-38452c05-4f95-4c98-8af1-73508346b192 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1297 microversion: 2.1 time: 0.105443 Jun 17 07:43:55.080338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 440/868] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:54 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:55.260693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-484ffdfd-bb85-46d4-8bc5-46d3565775c9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:55.262539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-484ffdfd-bb85-46d4-8bc5-46d3565775c9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:55.270718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-484ffdfd-bb85-46d4-8bc5-46d3565775c9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:55.271329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-484ffdfd-bb85-46d4-8bc5-46d3565775c9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:55.272106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-484ffdfd-bb85-46d4-8bc5-46d3565775c9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:55.272570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-484ffdfd-bb85-46d4-8bc5-46d3565775c9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:55.338383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-484ffdfd-bb85-46d4-8bc5-46d3565775c9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:55.346218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-484ffdfd-bb85-46d4-8bc5-46d3565775c9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1217 microversion: 2.1 time: 0.089727 Jun 17 07:43:55.347877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 429/869] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:55 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:56.096399 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-96167148-dbea-427d-847b-69b82ce11a4a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:56.097045 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-96167148-dbea-427d-847b-69b82ce11a4a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:56.103619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96167148-dbea-427d-847b-69b82ce11a4a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:56.105463 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96167148-dbea-427d-847b-69b82ce11a4a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:56.105463 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96167148-dbea-427d-847b-69b82ce11a4a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:56.105734 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-96167148-dbea-427d-847b-69b82ce11a4a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:56.292135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-96167148-dbea-427d-847b-69b82ce11a4a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:56.300546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-96167148-dbea-427d-847b-69b82ce11a4a tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.208018 Jun 17 07:43:56.301112 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 441/870] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:56 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:56.365433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-75e3f2b2-ebad-44a5-b161-afd1da616d3d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:56.366047 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-75e3f2b2-ebad-44a5-b161-afd1da616d3d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:56.377668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-75e3f2b2-ebad-44a5-b161-afd1da616d3d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:56.377668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-75e3f2b2-ebad-44a5-b161-afd1da616d3d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:56.377668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-75e3f2b2-ebad-44a5-b161-afd1da616d3d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:56.377668 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-75e3f2b2-ebad-44a5-b161-afd1da616d3d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:56.450753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-75e3f2b2-ebad-44a5-b161-afd1da616d3d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:56.460648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-75e3f2b2-ebad-44a5-b161-afd1da616d3d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1265 microversion: 2.1 time: 0.098869 Jun 17 07:43:56.461239 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 430/871] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:56 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:56.699658 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-1a153233-95d8-42c6-9d88-8c7c9a4a60d1 req-aadf2ee7-10ad-4604-9fb7-364e533f231b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d09958-4d1a-44e5-8f46-26f8d80d16b9", "tag": "daddb6c3-f14b-4972-9ac5-16d7ce07bba1"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:56.706302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-1a153233-95d8-42c6-9d88-8c7c9a4a60d1 req-aadf2ee7-10ad-4604-9fb7-364e533f231b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:56.706945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-1a153233-95d8-42c6-9d88-8c7c9a4a60d1 req-aadf2ee7-10ad-4604-9fb7-364e533f231b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:56.724734 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-1a153233-95d8-42c6-9d88-8c7c9a4a60d1 req-aadf2ee7-10ad-4604-9fb7-364e533f231b service nova] Creating event network-changed:daddb6c3-f14b-4972-9ac5-16d7ce07bba1 for instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 on hv-cinder-79733 Jun 17 07:43:56.731036 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-1a153233-95d8-42c6-9d88-8c7c9a4a60d1 req-aadf2ee7-10ad-4604-9fb7-364e533f231b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039464 Jun 17 07:43:56.731926 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 442/872] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:43:57.318931 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c4d11fd8-1a41-4212-822c-0b66c8e4c8c8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:57.319807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c4d11fd8-1a41-4212-822c-0b66c8e4c8c8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:57.327556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4d11fd8-1a41-4212-822c-0b66c8e4c8c8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:57.327556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4d11fd8-1a41-4212-822c-0b66c8e4c8c8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:57.328335 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4d11fd8-1a41-4212-822c-0b66c8e4c8c8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:57.328776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4d11fd8-1a41-4212-822c-0b66c8e4c8c8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:57.478935 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-784fe18e-a39f-48f7-8ee7-ed9660bbf22c tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:57.481108 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-784fe18e-a39f-48f7-8ee7-ed9660bbf22c tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:57.487937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-784fe18e-a39f-48f7-8ee7-ed9660bbf22c tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:57.488778 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-784fe18e-a39f-48f7-8ee7-ed9660bbf22c tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:57.489583 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-784fe18e-a39f-48f7-8ee7-ed9660bbf22c tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:57.489999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-784fe18e-a39f-48f7-8ee7-ed9660bbf22c tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:57.540628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c4d11fd8-1a41-4212-822c-0b66c8e4c8c8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:57.549269 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c4d11fd8-1a41-4212-822c-0b66c8e4c8c8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.234172 Jun 17 07:43:57.549916 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 431/873] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:57 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:57.688002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-784fe18e-a39f-48f7-8ee7-ed9660bbf22c tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:57.695546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-784fe18e-a39f-48f7-8ee7-ed9660bbf22c tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.221219 Jun 17 07:43:57.696112 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 443/874] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:57 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:58.384161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-5d8c5f4b-87bf-4e69-8925-dd2bb3b77c98 req-02e6ab6d-8148-4b80-a28d-b2f47f92254a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156ae4b6-bd74-4ed9-befe-bf08c060a14f", "tag": "ef8de494-2096-4c23-8c7f-ddc94014d9b9"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:43:58.393712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-5d8c5f4b-87bf-4e69-8925-dd2bb3b77c98 req-02e6ab6d-8148-4b80-a28d-b2f47f92254a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:58.394158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-5d8c5f4b-87bf-4e69-8925-dd2bb3b77c98 req-02e6ab6d-8148-4b80-a28d-b2f47f92254a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:58.405902 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-5d8c5f4b-87bf-4e69-8925-dd2bb3b77c98 req-02e6ab6d-8148-4b80-a28d-b2f47f92254a service nova] Creating event network-changed:ef8de494-2096-4c23-8c7f-ddc94014d9b9 for instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f on hv-cinder-79733 Jun 17 07:43:58.410921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-5d8c5f4b-87bf-4e69-8925-dd2bb3b77c98 req-02e6ab6d-8148-4b80-a28d-b2f47f92254a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030443 Jun 17 07:43:58.411533 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 432/875] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:43:58.566724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-40ecb97b-456a-4921-8b21-24939355d4ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:58.567321 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-40ecb97b-456a-4921-8b21-24939355d4ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:58.574294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-40ecb97b-456a-4921-8b21-24939355d4ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:58.574806 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-40ecb97b-456a-4921-8b21-24939355d4ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:58.575656 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-40ecb97b-456a-4921-8b21-24939355d4ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:58.576122 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-40ecb97b-456a-4921-8b21-24939355d4ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:58.710162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-40ecb97b-456a-4921-8b21-24939355d4ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:58.712476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dde9cbc5-e253-4447-a4e8-aedd03bac7e3 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:58.713168 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dde9cbc5-e253-4447-a4e8-aedd03bac7e3 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:58.718236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-40ecb97b-456a-4921-8b21-24939355d4ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.155313 Jun 17 07:43:58.718892 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 444/876] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:58 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:43:58.720003 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dde9cbc5-e253-4447-a4e8-aedd03bac7e3 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:58.720452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dde9cbc5-e253-4447-a4e8-aedd03bac7e3 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:58.721209 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dde9cbc5-e253-4447-a4e8-aedd03bac7e3 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:58.721764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dde9cbc5-e253-4447-a4e8-aedd03bac7e3 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:59.085548 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-dde9cbc5-e253-4447-a4e8-aedd03bac7e3 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:59.093474 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dde9cbc5-e253-4447-a4e8-aedd03bac7e3 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.385157 Jun 17 07:43:59.094037 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 433/877] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:58 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:43:59.735357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-53c4d7c3-93b8-4922-b1c4-dd7373ca5cfc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:43:59.736043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-53c4d7c3-93b8-4922-b1c4-dd7373ca5cfc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:43:59.742921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53c4d7c3-93b8-4922-b1c4-dd7373ca5cfc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:59.743398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53c4d7c3-93b8-4922-b1c4-dd7373ca5cfc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:59.744189 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53c4d7c3-93b8-4922-b1c4-dd7373ca5cfc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:43:59.744686 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-53c4d7c3-93b8-4922-b1c4-dd7373ca5cfc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:43:59.876303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-53c4d7c3-93b8-4922-b1c4-dd7373ca5cfc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:43:59.883735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-53c4d7c3-93b8-4922-b1c4-dd7373ca5cfc tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.152846 Jun 17 07:43:59.884502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 445/878] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:43:59 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:00.111336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f1a6a732-34ae-40a0-8f18-42936ba63fbd tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:00.112394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f1a6a732-34ae-40a0-8f18-42936ba63fbd tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:00.124821 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1a6a732-34ae-40a0-8f18-42936ba63fbd tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:00.125034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1a6a732-34ae-40a0-8f18-42936ba63fbd tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:00.126049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1a6a732-34ae-40a0-8f18-42936ba63fbd tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:00.126587 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f1a6a732-34ae-40a0-8f18-42936ba63fbd tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:00.258947 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f1a6a732-34ae-40a0-8f18-42936ba63fbd tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:00.266968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f1a6a732-34ae-40a0-8f18-42936ba63fbd tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.159968 Jun 17 07:44:00.267579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 434/879] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:00 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:00.902458 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9164530a-40c5-47b0-9f1a-b48d865b7745 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:00.903271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9164530a-40c5-47b0-9f1a-b48d865b7745 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:00.909756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9164530a-40c5-47b0-9f1a-b48d865b7745 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:00.910203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9164530a-40c5-47b0-9f1a-b48d865b7745 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:00.910993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9164530a-40c5-47b0-9f1a-b48d865b7745 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:00.911436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9164530a-40c5-47b0-9f1a-b48d865b7745 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:01.046070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9164530a-40c5-47b0-9f1a-b48d865b7745 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:01.053729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9164530a-40c5-47b0-9f1a-b48d865b7745 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.155323 Jun 17 07:44:01.054428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 446/880] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:00 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:01.284530 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-af9ab094-895b-462d-b7bc-d9cc0b825d1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:01.285143 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-af9ab094-895b-462d-b7bc-d9cc0b825d1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:01.292296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-af9ab094-895b-462d-b7bc-d9cc0b825d1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:01.292736 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-af9ab094-895b-462d-b7bc-d9cc0b825d1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:01.293737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-af9ab094-895b-462d-b7bc-d9cc0b825d1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:01.294174 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-af9ab094-895b-462d-b7bc-d9cc0b825d1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:01.430153 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-af9ab094-895b-462d-b7bc-d9cc0b825d1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:01.440063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-af9ab094-895b-462d-b7bc-d9cc0b825d1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.157506 Jun 17 07:44:01.440063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 435/881] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:01 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:02.070993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6fb9ce29-2377-4855-b6b8-72d09277a9ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:02.071654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6fb9ce29-2377-4855-b6b8-72d09277a9ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:02.078932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6fb9ce29-2377-4855-b6b8-72d09277a9ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:02.079432 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6fb9ce29-2377-4855-b6b8-72d09277a9ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:02.080341 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6fb9ce29-2377-4855-b6b8-72d09277a9ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:02.080779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6fb9ce29-2377-4855-b6b8-72d09277a9ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:02.217709 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6fb9ce29-2377-4855-b6b8-72d09277a9ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:02.225093 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6fb9ce29-2377-4855-b6b8-72d09277a9ba tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.157973 Jun 17 07:44:02.225683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 447/882] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:02 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:02.454295 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c4bc8ec1-5a03-45a1-9506-8bcbfacbcae8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:02.454908 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c4bc8ec1-5a03-45a1-9506-8bcbfacbcae8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:02.461477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4bc8ec1-5a03-45a1-9506-8bcbfacbcae8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:02.461931 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4bc8ec1-5a03-45a1-9506-8bcbfacbcae8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:02.462691 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4bc8ec1-5a03-45a1-9506-8bcbfacbcae8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:02.463189 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c4bc8ec1-5a03-45a1-9506-8bcbfacbcae8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:02.596805 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c4bc8ec1-5a03-45a1-9506-8bcbfacbcae8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:02.604321 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c4bc8ec1-5a03-45a1-9506-8bcbfacbcae8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.154191 Jun 17 07:44:02.604888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 436/883] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:02 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:03.242873 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7f844d4b-3903-4568-a79d-1f800cc65477 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:03.246355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7f844d4b-3903-4568-a79d-1f800cc65477 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:03.251186 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7f844d4b-3903-4568-a79d-1f800cc65477 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:03.251635 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7f844d4b-3903-4568-a79d-1f800cc65477 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:03.252390 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7f844d4b-3903-4568-a79d-1f800cc65477 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:03.252825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7f844d4b-3903-4568-a79d-1f800cc65477 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:03.389376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7f844d4b-3903-4568-a79d-1f800cc65477 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:03.397065 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7f844d4b-3903-4568-a79d-1f800cc65477 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.158087 Jun 17 07:44:03.400508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 448/884] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:03 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:03.410358 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-37c1bb94-ac79-4775-b560-21ce273617f6 req-e3ca34b0-a0d5-4331-8f69-72b0bd5ef8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d09958-4d1a-44e5-8f46-26f8d80d16b9", "name": "network-vif-plugged", "status": "completed", "tag": "daddb6c3-f14b-4972-9ac5-16d7ce07bba1"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:03.418750 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-37c1bb94-ac79-4775-b560-21ce273617f6 req-e3ca34b0-a0d5-4331-8f69-72b0bd5ef8ef service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:03.421971 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-37c1bb94-ac79-4775-b560-21ce273617f6 req-e3ca34b0-a0d5-4331-8f69-72b0bd5ef8ef service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:03.430032 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-37c1bb94-ac79-4775-b560-21ce273617f6 req-e3ca34b0-a0d5-4331-8f69-72b0bd5ef8ef service nova] Creating event network-vif-plugged:daddb6c3-f14b-4972-9ac5-16d7ce07bba1 for instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 on hv-cinder-79733 Jun 17 07:44:03.435888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-37c1bb94-ac79-4775-b560-21ce273617f6 req-e3ca34b0-a0d5-4331-8f69-72b0bd5ef8ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028702 Jun 17 07:44:03.436582 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 437/885] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:44:03.621807 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a82bfe96-8e05-4e8d-8afe-0279bd118bf7 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:03.622457 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a82bfe96-8e05-4e8d-8afe-0279bd118bf7 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:03.628398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a82bfe96-8e05-4e8d-8afe-0279bd118bf7 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:03.628842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a82bfe96-8e05-4e8d-8afe-0279bd118bf7 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:03.629626 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a82bfe96-8e05-4e8d-8afe-0279bd118bf7 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:03.630096 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a82bfe96-8e05-4e8d-8afe-0279bd118bf7 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:03.764101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a82bfe96-8e05-4e8d-8afe-0279bd118bf7 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:03.771739 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a82bfe96-8e05-4e8d-8afe-0279bd118bf7 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.153751 Jun 17 07:44:03.772309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 449/886] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:03 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:04.412702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=8 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:04.416892 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7f521ae6-c683-4369-a4d7-8bbd561c8519 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:04.417630 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7f521ae6-c683-4369-a4d7-8bbd561c8519 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:04.424379 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7f521ae6-c683-4369-a4d7-8bbd561c8519 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:04.424823 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7f521ae6-c683-4369-a4d7-8bbd561c8519 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:04.425611 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7f521ae6-c683-4369-a4d7-8bbd561c8519 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:04.426043 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7f521ae6-c683-4369-a4d7-8bbd561c8519 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:04.556545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7f521ae6-c683-4369-a4d7-8bbd561c8519 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:04.563731 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7f521ae6-c683-4369-a4d7-8bbd561c8519 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.152596 Jun 17 07:44:04.564313 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 438/887] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:04 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:04.788547 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f0497531-14c0-40fa-a309-64cc017e1b71 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:04.789156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f0497531-14c0-40fa-a309-64cc017e1b71 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:04.791103 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=4 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:04.791750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=12 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:04.797003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0497531-14c0-40fa-a309-64cc017e1b71 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:04.800823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0497531-14c0-40fa-a309-64cc017e1b71 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:04.800823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0497531-14c0-40fa-a309-64cc017e1b71 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:04.800823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0497531-14c0-40fa-a309-64cc017e1b71 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:04.929567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0497531-14c0-40fa-a309-64cc017e1b71 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:04.937012 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f0497531-14c0-40fa-a309-64cc017e1b71 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.152241 Jun 17 07:44:04.937824 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 450/888] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:04 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:05.580988 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-20b27773-138a-4b2e-927a-bdf0f4824f86 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:05.581779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-20b27773-138a-4b2e-927a-bdf0f4824f86 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:05.588939 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-20b27773-138a-4b2e-927a-bdf0f4824f86 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:05.589406 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-20b27773-138a-4b2e-927a-bdf0f4824f86 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:05.590309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-20b27773-138a-4b2e-927a-bdf0f4824f86 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:05.590783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-20b27773-138a-4b2e-927a-bdf0f4824f86 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:05.732505 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-20b27773-138a-4b2e-927a-bdf0f4824f86 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:05.740521 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-20b27773-138a-4b2e-927a-bdf0f4824f86 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1361 microversion: 2.1 time: 0.164429 Jun 17 07:44:05.749462 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 439/889] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:05 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:05.954474 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f6ea84ae-eca1-457d-b97a-c8bc02dea4c2 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:05.955179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f6ea84ae-eca1-457d-b97a-c8bc02dea4c2 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:05.961607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f6ea84ae-eca1-457d-b97a-c8bc02dea4c2 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:05.962137 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f6ea84ae-eca1-457d-b97a-c8bc02dea4c2 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:05.962905 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f6ea84ae-eca1-457d-b97a-c8bc02dea4c2 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:05.963340 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f6ea84ae-eca1-457d-b97a-c8bc02dea4c2 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:06.336905 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f6ea84ae-eca1-457d-b97a-c8bc02dea4c2 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:06.344377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f6ea84ae-eca1-457d-b97a-c8bc02dea4c2 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.394140 Jun 17 07:44:06.345946 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 451/890] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:05 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:06.758763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1b2d7ad1-0ac7-44f9-a8fb-a917f8f4206f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:06.759592 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1b2d7ad1-0ac7-44f9-a8fb-a917f8f4206f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:06.767006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1b2d7ad1-0ac7-44f9-a8fb-a917f8f4206f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:06.767566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1b2d7ad1-0ac7-44f9-a8fb-a917f8f4206f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:06.768394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1b2d7ad1-0ac7-44f9-a8fb-a917f8f4206f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:06.768927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1b2d7ad1-0ac7-44f9-a8fb-a917f8f4206f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:06.897783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1b2d7ad1-0ac7-44f9-a8fb-a917f8f4206f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:06.905296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1b2d7ad1-0ac7-44f9-a8fb-a917f8f4206f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1547 microversion: 2.1 time: 0.150799 Jun 17 07:44:06.905884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 440/891] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:06 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:06.922345 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-97c05461-6ebb-4cc8-ad72-774f17aead6d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:06.922960 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-97c05461-6ebb-4cc8-ad72-774f17aead6d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:06.928943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97c05461-6ebb-4cc8-ad72-774f17aead6d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:06.929426 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97c05461-6ebb-4cc8-ad72-774f17aead6d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:06.930205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97c05461-6ebb-4cc8-ad72-774f17aead6d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:06.930637 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-97c05461-6ebb-4cc8-ad72-774f17aead6d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:06.934195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:07.008209 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-97c05461-6ebb-4cc8-ad72-774f17aead6d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089494 Jun 17 07:44:07.008803 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 452/892] 10.222.0.52 () {58 vars in 1274 bytes} [Fri Jun 17 07:44:06 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:44:07.365737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b949c874-0ddd-4a23-bbd9-d7f8409e963b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:07.366933 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b949c874-0ddd-4a23-bbd9-d7f8409e963b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:07.377794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b949c874-0ddd-4a23-bbd9-d7f8409e963b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:07.377794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b949c874-0ddd-4a23-bbd9-d7f8409e963b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:07.377794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b949c874-0ddd-4a23-bbd9-d7f8409e963b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:07.377794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b949c874-0ddd-4a23-bbd9-d7f8409e963b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:07.402817 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:07.415783 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-3a6cb8f7-ba85-44cb-afec-9089b6d39e77 req-3ee967bd-7249-4de7-9acf-010fff0b443a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156ae4b6-bd74-4ed9-befe-bf08c060a14f", "name": "network-vif-plugged", "status": "completed", "tag": "ef8de494-2096-4c23-8c7f-ddc94014d9b9"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:07.424613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-3a6cb8f7-ba85-44cb-afec-9089b6d39e77 req-3ee967bd-7249-4de7-9acf-010fff0b443a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:07.425050 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-3a6cb8f7-ba85-44cb-afec-9089b6d39e77 req-3ee967bd-7249-4de7-9acf-010fff0b443a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:07.439176 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-3a6cb8f7-ba85-44cb-afec-9089b6d39e77 req-3ee967bd-7249-4de7-9acf-010fff0b443a service nova] Creating event network-vif-plugged:ef8de494-2096-4c23-8c7f-ddc94014d9b9 for instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f on hv-cinder-79733 Jun 17 07:44:07.442336 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-3a6cb8f7-ba85-44cb-afec-9089b6d39e77 req-3ee967bd-7249-4de7-9acf-010fff0b443a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030498 Jun 17 07:44:07.443039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 453/893] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:44:07.550147 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b949c874-0ddd-4a23-bbd9-d7f8409e963b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:07.558118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b949c874-0ddd-4a23-bbd9-d7f8409e963b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.199127 Jun 17 07:44:07.558703 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 441/894] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:07 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:08.024131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-40ca1263-0575-470b-8de7-c53601443237 req-9e64dcba-c01b-4d09-b866-d257613dca12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d09958-4d1a-44e5-8f46-26f8d80d16b9", "tag": "daddb6c3-f14b-4972-9ac5-16d7ce07bba1"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:08.034964 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-40ca1263-0575-470b-8de7-c53601443237 req-9e64dcba-c01b-4d09-b866-d257613dca12 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:08.035547 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-40ca1263-0575-470b-8de7-c53601443237 req-9e64dcba-c01b-4d09-b866-d257613dca12 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:08.049704 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-40ca1263-0575-470b-8de7-c53601443237 req-9e64dcba-c01b-4d09-b866-d257613dca12 service nova] Creating event network-changed:daddb6c3-f14b-4972-9ac5-16d7ce07bba1 for instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 on hv-cinder-79733 Jun 17 07:44:08.055744 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-40ca1263-0575-470b-8de7-c53601443237 req-9e64dcba-c01b-4d09-b866-d257613dca12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037232 Jun 17 07:44:08.056445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 454/895] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:44:08.577186 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-154a5eb5-9dc0-4153-a245-bcb829c508ae tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:08.578010 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-154a5eb5-9dc0-4153-a245-bcb829c508ae tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:08.585466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-154a5eb5-9dc0-4153-a245-bcb829c508ae tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:08.585922 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-154a5eb5-9dc0-4153-a245-bcb829c508ae tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:08.586695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-154a5eb5-9dc0-4153-a245-bcb829c508ae tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:08.587135 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-154a5eb5-9dc0-4153-a245-bcb829c508ae tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:08.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-154a5eb5-9dc0-4153-a245-bcb829c508ae tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:08.730387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-154a5eb5-9dc0-4153-a245-bcb829c508ae tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1313 microversion: 2.1 time: 0.157926 Jun 17 07:44:08.730980 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 442/896] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:08 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:09.748345 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-eaf0e7f9-f2d6-403d-acca-0ec5e310b5b0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:09.749033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-eaf0e7f9-f2d6-403d-acca-0ec5e310b5b0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:09.755613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-eaf0e7f9-f2d6-403d-acca-0ec5e310b5b0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:09.756048 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-eaf0e7f9-f2d6-403d-acca-0ec5e310b5b0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:09.756797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-eaf0e7f9-f2d6-403d-acca-0ec5e310b5b0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:09.757229 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-eaf0e7f9-f2d6-403d-acca-0ec5e310b5b0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:09.892474 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-eaf0e7f9-f2d6-403d-acca-0ec5e310b5b0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:09.902113 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-eaf0e7f9-f2d6-403d-acca-0ec5e310b5b0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1498 microversion: 2.1 time: 0.157757 Jun 17 07:44:09.914203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 455/897] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:09 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:10.776869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5a150cb4-7a8f-46a2-bd96-d7973ff11107 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:10.777427 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5a150cb4-7a8f-46a2-bd96-d7973ff11107 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:10.784340 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a150cb4-7a8f-46a2-bd96-d7973ff11107 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:10.784782 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a150cb4-7a8f-46a2-bd96-d7973ff11107 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:10.785629 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a150cb4-7a8f-46a2-bd96-d7973ff11107 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:10.786061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5a150cb4-7a8f-46a2-bd96-d7973ff11107 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:10.811528 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5a150cb4-7a8f-46a2-bd96-d7973ff11107 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:44:11.110329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5a150cb4-7a8f-46a2-bd96-d7973ff11107 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "DELETE /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 204 len: 0 microversion: 2.1 time: 0.336899 Jun 17 07:44:11.110922 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 443/898] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:44:10 2022] DELETE /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:44:11.119154 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-23594f17-c6b1-43c4-b563-2fdb3ccb79d9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:11.119794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-23594f17-c6b1-43c4-b563-2fdb3ccb79d9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:11.126482 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-23594f17-c6b1-43c4-b563-2fdb3ccb79d9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:11.126923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-23594f17-c6b1-43c4-b563-2fdb3ccb79d9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:11.127680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-23594f17-c6b1-43c4-b563-2fdb3ccb79d9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:11.128111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-23594f17-c6b1-43c4-b563-2fdb3ccb79d9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:11.262408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-23594f17-c6b1-43c4-b563-2fdb3ccb79d9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:11.269652 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-23594f17-c6b1-43c4-b563-2fdb3ccb79d9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1504 microversion: 2.1 time: 0.154375 Jun 17 07:44:11.270218 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 456/899] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:11 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:12.289441 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4046bfdf-cbae-4c49-9da4-643e5d761e43 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:12.290128 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4046bfdf-cbae-4c49-9da4-643e5d761e43 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:12.296962 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4046bfdf-cbae-4c49-9da4-643e5d761e43 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:12.297493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4046bfdf-cbae-4c49-9da4-643e5d761e43 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:12.298286 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4046bfdf-cbae-4c49-9da4-643e5d761e43 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:12.298757 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4046bfdf-cbae-4c49-9da4-643e5d761e43 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:12.440419 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4046bfdf-cbae-4c49-9da4-643e5d761e43 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:12.449039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4046bfdf-cbae-4c49-9da4-643e5d761e43 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1504 microversion: 2.1 time: 0.163897 Jun 17 07:44:12.449716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 444/900] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:12 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:13.347260 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-e0c39e87-71e4-4c84-a155-0088369a3170 req-babaf97a-4eb6-4620-b95b-c3350d0952d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156ae4b6-bd74-4ed9-befe-bf08c060a14f", "name": "network-vif-deleted", "tag": "ef8de494-2096-4c23-8c7f-ddc94014d9b9"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:13.356200 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-e0c39e87-71e4-4c84-a155-0088369a3170 req-babaf97a-4eb6-4620-b95b-c3350d0952d1 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:13.360053 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-e0c39e87-71e4-4c84-a155-0088369a3170 req-babaf97a-4eb6-4620-b95b-c3350d0952d1 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:13.371729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-e0c39e87-71e4-4c84-a155-0088369a3170 req-babaf97a-4eb6-4620-b95b-c3350d0952d1 service nova] Creating event network-vif-deleted:ef8de494-2096-4c23-8c7f-ddc94014d9b9 for instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f on hv-cinder-79733 Jun 17 07:44:13.376722 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-e0c39e87-71e4-4c84-a155-0088369a3170 req-babaf97a-4eb6-4620-b95b-c3350d0952d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033248 Jun 17 07:44:13.377336 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 457/901] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:44:13.467706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f82e0ad4-d9a8-488d-a995-4ee4d900fc5e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:13.468345 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f82e0ad4-d9a8-488d-a995-4ee4d900fc5e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:13.474464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f82e0ad4-d9a8-488d-a995-4ee4d900fc5e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:13.475571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f82e0ad4-d9a8-488d-a995-4ee4d900fc5e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:13.476335 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f82e0ad4-d9a8-488d-a995-4ee4d900fc5e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:13.476767 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f82e0ad4-d9a8-488d-a995-4ee4d900fc5e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:13.540268 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f82e0ad4-d9a8-488d-a995-4ee4d900fc5e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:13.547865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f82e0ad4-d9a8-488d-a995-4ee4d900fc5e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1462 microversion: 2.1 time: 0.084042 Jun 17 07:44:13.548438 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 445/902] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:13 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:14.565864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:14.566633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:14.568747 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:14.578389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:14.578389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:14.578389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:14.578389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:14.606920 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:14.607363 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:14.607815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lazy-loading 'fault' on Instance uuid 156ae4b6-bd74-4ed9-befe-bf08c060a14f {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:44:14.650255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:14.657024 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ccf5c850-3675-4403-bf22-da7070a0fe2f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 200 len: 1303 microversion: 2.1 time: 0.095981 Jun 17 07:44:14.657611 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 458/903] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:14 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:15.675291 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:15.675898 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 156ae4b6-bd74-4ed9-befe-bf08c060a14f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:15.678522 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:15.683568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:15.684016 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:15.684813 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:15.685249 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:15.698805 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] HTTP exception thrown: Instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f could not be found. Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Request method failure captured: Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f HTTP/1.1 Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDC2-LS7EpN_9_g2C6PQAtCC9Vrf7BADVUtuhIUL3Rx0KLYqRZNtrSvI1_6aYi_1yAG0enXy1o9SFUtkfyf66agyZU4sgrf0oOM82lC3hyf4K3RFQAEQhfIjXv3uWUAeDipQuEmQ6QQ9oEQvWLkNPliKAB56bHJxsb0GeE5NHBbtfGI Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 5fe594d24d9843acbec2e846c98c14ae Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-VolumesActionsTest-1232333641 Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:44:15.701123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fe594d24d9843acbec2e846c98c14ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fe594d24d9843acbec2e846c98c14ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fe594d24d9843acbec2e846c98c14ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fe594d24d9843acbec2e846c98c14ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-VolumesActionsTest-1232333641 Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 5fe594d24d9843acbec2e846c98c14ae Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-VolumesActionsTest-1232333641 Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-VolumesActionsTest-1232333641-project Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 8be176511fa34aa6aa5fe83bc6a2b163 Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-VolumesActionsTest-1232333641-project Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f could not be found. Jun 17 07:44:15.702784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '156ae4b6-bd74-4ed9-befe-bf08c060a14f'} Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f could not be found. Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:44:15.703667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f could not be found. Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f could not be found. Jun 17 07:44:15.705413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:15.706779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Returning 404 to user: Instance 156ae4b6-bd74-4ed9-befe-bf08c060a14f could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:44:15.706779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-06d66ed5-48e7-45b2-a33f-a5fec0f1f5c8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f" status: 404 len: 111 microversion: 2.1 time: 0.031166 Jun 17 07:44:15.706779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 446/904] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:15 2022] GET /compute/v2.1/servers/156ae4b6-bd74-4ed9-befe-bf08c060a14f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:44:15.752822 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1581216533", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "networks": [{"uuid": "46e5867d-8690-4d3c-b1a3-8d804e630659"}]}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:15.803712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] validate_networks() for [('46e5867d-8690-4d3c-b1a3-8d804e630659', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:44:16.152255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:44:16.152683 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:44:16.153159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:44:16.153764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:44:16.158581 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:44:16.162869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:16.163318 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:16.168119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:16.168119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:16.188269 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Getting quotas for project 5fe594d24d9843acbec2e846c98c14ae. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:44:16.192564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Getting quotas for user 8be176511fa34aa6aa5fe83bc6a2b163 and project 5fe594d24d9843acbec2e846c98c14ae. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:44:16.204104 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:44:16.206542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:44:16.415139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-63b5cc97-4d16-405a-8aa3-0a7f018d0de5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666363 Jun 17 07:44:16.415797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 459/905] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:44:16.426076 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-13e97f3b-1475-451f-9c2c-f831ef45e890 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:16.426822 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-13e97f3b-1475-451f-9c2c-f831ef45e890 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:16.483562 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-13e97f3b-1475-451f-9c2c-f831ef45e890 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:16.490891 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-13e97f3b-1475-451f-9c2c-f831ef45e890 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1214 microversion: 2.1 time: 0.068967 Jun 17 07:44:16.491456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 447/906] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:16 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:17.509097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6df0eb54-35e8-4269-bcfa-b5817c45ba36 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:17.509741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6df0eb54-35e8-4269-bcfa-b5817c45ba36 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:17.516392 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6df0eb54-35e8-4269-bcfa-b5817c45ba36 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:17.516832 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6df0eb54-35e8-4269-bcfa-b5817c45ba36 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:17.517613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6df0eb54-35e8-4269-bcfa-b5817c45ba36 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:17.518041 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6df0eb54-35e8-4269-bcfa-b5817c45ba36 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:17.577921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6df0eb54-35e8-4269-bcfa-b5817c45ba36 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:17.585244 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6df0eb54-35e8-4269-bcfa-b5817c45ba36 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1218 microversion: 2.1 time: 0.080623 Jun 17 07:44:17.585991 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 460/907] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:17 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:18.603325 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0f34efbe-ba90-425e-b57f-893f180d0bc8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:18.604055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0f34efbe-ba90-425e-b57f-893f180d0bc8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:18.612703 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f34efbe-ba90-425e-b57f-893f180d0bc8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:18.613164 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f34efbe-ba90-425e-b57f-893f180d0bc8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:18.613968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f34efbe-ba90-425e-b57f-893f180d0bc8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:18.614414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f34efbe-ba90-425e-b57f-893f180d0bc8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:18.683006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0f34efbe-ba90-425e-b57f-893f180d0bc8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:18.690920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0f34efbe-ba90-425e-b57f-893f180d0bc8 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1210 microversion: 2.1 time: 0.092180 Jun 17 07:44:18.691495 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 448/908] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:18 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:19.709180 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-24314409-2472-4a45-84de-772e93bb61ce tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:19.709836 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-24314409-2472-4a45-84de-772e93bb61ce tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:19.717248 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24314409-2472-4a45-84de-772e93bb61ce tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:19.717735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24314409-2472-4a45-84de-772e93bb61ce tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:19.718509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24314409-2472-4a45-84de-772e93bb61ce tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:19.718943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24314409-2472-4a45-84de-772e93bb61ce tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:19.782378 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-24314409-2472-4a45-84de-772e93bb61ce tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:19.790320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-24314409-2472-4a45-84de-772e93bb61ce tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1284 microversion: 2.1 time: 0.084925 Jun 17 07:44:19.790936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 461/909] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:19 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:20.807907 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a75f181e-cf8a-4eba-b968-19173f01a47f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:20.808634 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a75f181e-cf8a-4eba-b968-19173f01a47f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:20.815038 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a75f181e-cf8a-4eba-b968-19173f01a47f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:20.815514 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a75f181e-cf8a-4eba-b968-19173f01a47f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:20.816273 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a75f181e-cf8a-4eba-b968-19173f01a47f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:20.816719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a75f181e-cf8a-4eba-b968-19173f01a47f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:21.040132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a75f181e-cf8a-4eba-b968-19173f01a47f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:21.048225 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a75f181e-cf8a-4eba-b968-19173f01a47f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.244380 Jun 17 07:44:21.048624 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 449/910] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:20 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:21.248573 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-ed904787-9d3f-4ee8-8906-b186b2e895cb req-43612a07-49b9-4abf-b734-edb9ead07aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351d4b96-9767-4002-be54-c8b9d8bfaf9f", "tag": "8d8a89ec-790c-499d-a109-8b3365f52d24"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:21.258880 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-ed904787-9d3f-4ee8-8906-b186b2e895cb req-43612a07-49b9-4abf-b734-edb9ead07aaa service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:21.259327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-ed904787-9d3f-4ee8-8906-b186b2e895cb req-43612a07-49b9-4abf-b734-edb9ead07aaa service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:21.270765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-ed904787-9d3f-4ee8-8906-b186b2e895cb req-43612a07-49b9-4abf-b734-edb9ead07aaa service nova] Creating event network-changed:8d8a89ec-790c-499d-a109-8b3365f52d24 for instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f on hv-cinder-79733 Jun 17 07:44:21.276407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-ed904787-9d3f-4ee8-8906-b186b2e895cb req-43612a07-49b9-4abf-b734-edb9ead07aaa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031794 Jun 17 07:44:21.277030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 462/911] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:44:22.065936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2e0bc2f6-1dce-4752-ae52-25eee9975187 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:22.066540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2e0bc2f6-1dce-4752-ae52-25eee9975187 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:22.074563 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e0bc2f6-1dce-4752-ae52-25eee9975187 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:22.075004 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e0bc2f6-1dce-4752-ae52-25eee9975187 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:22.075849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e0bc2f6-1dce-4752-ae52-25eee9975187 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:22.076279 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2e0bc2f6-1dce-4752-ae52-25eee9975187 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:22.207388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2e0bc2f6-1dce-4752-ae52-25eee9975187 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:22.215361 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2e0bc2f6-1dce-4752-ae52-25eee9975187 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.153503 Jun 17 07:44:22.215923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 450/912] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:22 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:23.233737 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3b80b52c-6531-4d1b-a86d-a3293beb4c4d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:23.234429 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3b80b52c-6531-4d1b-a86d-a3293beb4c4d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:23.240773 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b80b52c-6531-4d1b-a86d-a3293beb4c4d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:23.241304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b80b52c-6531-4d1b-a86d-a3293beb4c4d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:23.242607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b80b52c-6531-4d1b-a86d-a3293beb4c4d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:23.243034 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3b80b52c-6531-4d1b-a86d-a3293beb4c4d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:23.375875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3b80b52c-6531-4d1b-a86d-a3293beb4c4d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:23.383564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3b80b52c-6531-4d1b-a86d-a3293beb4c4d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.154851 Jun 17 07:44:23.384130 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 463/913] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:23 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:24.400833 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7de6989d-5dab-435e-a14b-a1520c60791d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:24.401508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7de6989d-5dab-435e-a14b-a1520c60791d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:24.407837 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7de6989d-5dab-435e-a14b-a1520c60791d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:24.408281 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7de6989d-5dab-435e-a14b-a1520c60791d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:24.409038 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7de6989d-5dab-435e-a14b-a1520c60791d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:24.409508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7de6989d-5dab-435e-a14b-a1520c60791d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:24.653535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7de6989d-5dab-435e-a14b-a1520c60791d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:24.660970 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7de6989d-5dab-435e-a14b-a1520c60791d tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.264773 Jun 17 07:44:24.661604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 451/914] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:24 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:25.678258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9eb32011-f883-4de4-b67a-49b88f7676f5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:25.679041 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9eb32011-f883-4de4-b67a-49b88f7676f5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:25.685805 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9eb32011-f883-4de4-b67a-49b88f7676f5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:25.686269 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9eb32011-f883-4de4-b67a-49b88f7676f5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:25.687023 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9eb32011-f883-4de4-b67a-49b88f7676f5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:25.687465 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9eb32011-f883-4de4-b67a-49b88f7676f5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:25.871493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9eb32011-f883-4de4-b67a-49b88f7676f5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:25.878760 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9eb32011-f883-4de4-b67a-49b88f7676f5 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.204502 Jun 17 07:44:25.879322 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 464/915] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:25 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:26.896633 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c174d678-2fd1-4e8c-b1c6-fbfe310ecd49 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:26.901913 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c174d678-2fd1-4e8c-b1c6-fbfe310ecd49 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:26.901913 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:26.905471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c174d678-2fd1-4e8c-b1c6-fbfe310ecd49 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:26.905471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c174d678-2fd1-4e8c-b1c6-fbfe310ecd49 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:26.906138 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c174d678-2fd1-4e8c-b1c6-fbfe310ecd49 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:26.906596 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c174d678-2fd1-4e8c-b1c6-fbfe310ecd49 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:27.065190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c174d678-2fd1-4e8c-b1c6-fbfe310ecd49 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:27.070450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1078225855", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1192281260", "security_groups": [{"name": "tempest-secgroup-smoke-962214724"}], "block_device_mapping_v2": [{"uuid": "837b2800-d707-45fa-b758-f631d3946cec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "156b13e9-64a4-4462-8a1a-126909d8e3f9"}]}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:27.074498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c174d678-2fd1-4e8c-b1c6-fbfe310ecd49 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.182127 Jun 17 07:44:27.075122 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 452/916] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:26 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:27.080247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:27.080904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:27.188071 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] validate_networks() for [('156b13e9-64a4-4462-8a1a-126909d8e3f9', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:44:27.579525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:44:27.579966 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:44:27.580433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:44:27.580857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:44:27.581260 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:44:27.590987 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:27.591431 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:27.592215 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:27.592641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:27.609900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Getting quotas for project 8705999014cf43e1b1ccd5186b67b4bd. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:44:27.613784 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Getting quotas for user 781e29f49f27417a96cfc4ba00af95dd and project 8705999014cf43e1b1ccd5186b67b4bd. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:44:27.671932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:44:27.674152 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='837b2800-d707-45fa-b758-f631d3946cec',volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:44:28.091824 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-448789a5-f60c-4a74-90d5-bce99f979c6b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:28.092421 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-448789a5-f60c-4a74-90d5-bce99f979c6b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:28.098819 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-448789a5-f60c-4a74-90d5-bce99f979c6b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:28.099263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-448789a5-f60c-4a74-90d5-bce99f979c6b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:28.100021 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-448789a5-f60c-4a74-90d5-bce99f979c6b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:28.100458 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-448789a5-f60c-4a74-90d5-bce99f979c6b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:28.171048 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7cb11835-ba29-49ba-b9ca-e44761881071 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.104382 Jun 17 07:44:28.174281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 465/917] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:44:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:44:28.183646 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f6aebd0a-ddbe-4711-ba0f-9a7ef1c84ca4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:28.184735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f6aebd0a-ddbe-4711-ba0f-9a7ef1c84ca4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:28.245981 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f6aebd0a-ddbe-4711-ba0f-9a7ef1c84ca4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:28.253784 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f6aebd0a-ddbe-4711-ba0f-9a7ef1c84ca4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1095 microversion: 2.1 time: 0.075657 Jun 17 07:44:28.264285 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 466/918] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:28 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:28.269867 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-448789a5-f60c-4a74-90d5-bce99f979c6b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:28.277822 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-448789a5-f60c-4a74-90d5-bce99f979c6b tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.189730 Jun 17 07:44:28.278416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 453/919] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:28 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:28.498763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-c33caab3-7ee5-4aeb-8ab0-c60008caa5c6 req-ded2d9d1-e7f5-4bf5-8e69-c8f36aafe4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351d4b96-9767-4002-be54-c8b9d8bfaf9f", "name": "network-vif-plugged", "status": "completed", "tag": "8d8a89ec-790c-499d-a109-8b3365f52d24"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:28.507572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c33caab3-7ee5-4aeb-8ab0-c60008caa5c6 req-ded2d9d1-e7f5-4bf5-8e69-c8f36aafe4b7 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:28.515171 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c33caab3-7ee5-4aeb-8ab0-c60008caa5c6 req-ded2d9d1-e7f5-4bf5-8e69-c8f36aafe4b7 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:28.519502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-c33caab3-7ee5-4aeb-8ab0-c60008caa5c6 req-ded2d9d1-e7f5-4bf5-8e69-c8f36aafe4b7 service nova] Creating event network-vif-plugged:8d8a89ec-790c-499d-a109-8b3365f52d24 for instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f on hv-cinder-79733 Jun 17 07:44:28.524447 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-c33caab3-7ee5-4aeb-8ab0-c60008caa5c6 req-ded2d9d1-e7f5-4bf5-8e69-c8f36aafe4b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029349 Jun 17 07:44:28.525043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 467/920] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:44:29.271618 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ae1b017f-fb03-4153-aa2a-0f6bb4b79063 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:29.272222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ae1b017f-fb03-4153-aa2a-0f6bb4b79063 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:29.279329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ae1b017f-fb03-4153-aa2a-0f6bb4b79063 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:29.279770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ae1b017f-fb03-4153-aa2a-0f6bb4b79063 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:29.280520 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ae1b017f-fb03-4153-aa2a-0f6bb4b79063 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:29.280951 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ae1b017f-fb03-4153-aa2a-0f6bb4b79063 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:29.295507 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7dacc25d-78b7-4947-b428-15dae881c4ef tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:29.296225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7dacc25d-78b7-4947-b428-15dae881c4ef tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:29.302342 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7dacc25d-78b7-4947-b428-15dae881c4ef tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:29.302779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7dacc25d-78b7-4947-b428-15dae881c4ef tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:29.303528 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7dacc25d-78b7-4947-b428-15dae881c4ef tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:29.303959 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7dacc25d-78b7-4947-b428-15dae881c4ef tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:29.345018 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ae1b017f-fb03-4153-aa2a-0f6bb4b79063 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:29.352812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ae1b017f-fb03-4153-aa2a-0f6bb4b79063 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1145 microversion: 2.1 time: 0.085015 Jun 17 07:44:29.353422 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 454/921] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:29 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:29.434690 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7dacc25d-78b7-4947-b428-15dae881c4ef tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:29.442146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7dacc25d-78b7-4947-b428-15dae881c4ef tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.151278 Jun 17 07:44:29.442779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 468/922] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:29 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:30.370325 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8223e880-2a74-45f2-9034-4b02a2c0b79f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:30.371083 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8223e880-2a74-45f2-9034-4b02a2c0b79f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:30.377691 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8223e880-2a74-45f2-9034-4b02a2c0b79f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:30.378137 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8223e880-2a74-45f2-9034-4b02a2c0b79f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:30.378898 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8223e880-2a74-45f2-9034-4b02a2c0b79f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:30.379329 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8223e880-2a74-45f2-9034-4b02a2c0b79f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:30.453035 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8223e880-2a74-45f2-9034-4b02a2c0b79f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:30.460578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-df13bbef-345e-41e8-9419-91289d75f6ec tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:30.461755 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8223e880-2a74-45f2-9034-4b02a2c0b79f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1137 microversion: 2.1 time: 0.095229 Jun 17 07:44:30.462664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-df13bbef-345e-41e8-9419-91289d75f6ec tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:30.471926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 455/923] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:30 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1137 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:30.478796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df13bbef-345e-41e8-9419-91289d75f6ec tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:30.479316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df13bbef-345e-41e8-9419-91289d75f6ec tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:30.480157 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df13bbef-345e-41e8-9419-91289d75f6ec tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:30.480659 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df13bbef-345e-41e8-9419-91289d75f6ec tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:30.616248 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-df13bbef-345e-41e8-9419-91289d75f6ec tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:30.623969 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-df13bbef-345e-41e8-9419-91289d75f6ec tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1314 microversion: 2.1 time: 0.167960 Jun 17 07:44:30.624536 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 469/924] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:30 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:31.479561 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-37249fcc-ac1f-495e-8b02-f8007f711b05 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:31.480171 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-37249fcc-ac1f-495e-8b02-f8007f711b05 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:31.486868 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-37249fcc-ac1f-495e-8b02-f8007f711b05 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:31.487337 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-37249fcc-ac1f-495e-8b02-f8007f711b05 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:31.488077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-37249fcc-ac1f-495e-8b02-f8007f711b05 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:31.488512 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-37249fcc-ac1f-495e-8b02-f8007f711b05 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:31.550316 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-37249fcc-ac1f-495e-8b02-f8007f711b05 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:31.558617 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-37249fcc-ac1f-495e-8b02-f8007f711b05 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1193 microversion: 2.1 time: 0.083817 Jun 17 07:44:31.559193 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 456/925] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:31 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:31.642177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e199a77a-16ef-4715-8a2f-227b46f56635 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:31.642788 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e199a77a-16ef-4715-8a2f-227b46f56635 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:31.649286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e199a77a-16ef-4715-8a2f-227b46f56635 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:31.649780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e199a77a-16ef-4715-8a2f-227b46f56635 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:31.651010 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e199a77a-16ef-4715-8a2f-227b46f56635 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:31.651452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e199a77a-16ef-4715-8a2f-227b46f56635 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:31.783757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e199a77a-16ef-4715-8a2f-227b46f56635 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:31.791780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e199a77a-16ef-4715-8a2f-227b46f56635 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1499 microversion: 2.1 time: 0.154184 Jun 17 07:44:31.792346 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 470/926] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:31 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1499 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:32.576167 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b690d3e3-d90c-4c3d-9781-fe5c01e3fb7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:32.576884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b690d3e3-d90c-4c3d-9781-fe5c01e3fb7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:32.584045 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b690d3e3-d90c-4c3d-9781-fe5c01e3fb7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:32.584494 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b690d3e3-d90c-4c3d-9781-fe5c01e3fb7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:32.585265 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b690d3e3-d90c-4c3d-9781-fe5c01e3fb7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:32.585770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b690d3e3-d90c-4c3d-9781-fe5c01e3fb7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:32.838409 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b690d3e3-d90c-4c3d-9781-fe5c01e3fb7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:32.854510 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b690d3e3-d90c-4c3d-9781-fe5c01e3fb7a tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1211 microversion: 2.1 time: 0.275198 Jun 17 07:44:32.854510 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 457/927] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:32 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1211 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:32.860664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0ef9c5d0-35c8-45dd-bf3b-5619ba4131e0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:32.861221 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0ef9c5d0-35c8-45dd-bf3b-5619ba4131e0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:32.867864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ef9c5d0-35c8-45dd-bf3b-5619ba4131e0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:32.868309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ef9c5d0-35c8-45dd-bf3b-5619ba4131e0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:32.869882 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ef9c5d0-35c8-45dd-bf3b-5619ba4131e0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:32.870288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ef9c5d0-35c8-45dd-bf3b-5619ba4131e0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:32.897038 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0ef9c5d0-35c8-45dd-bf3b-5619ba4131e0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Going to try to terminate instance {{(pid=124472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:44:33.298464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0ef9c5d0-35c8-45dd-bf3b-5619ba4131e0 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "DELETE /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 204 len: 0 microversion: 2.1 time: 0.442117 Jun 17 07:44:33.299065 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 471/928] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:44:32 2022] DELETE /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:44:33.308523 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-65f9545a-baa6-4db9-a106-c67245bd7a1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:33.311982 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-65f9545a-baa6-4db9-a106-c67245bd7a1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:33.316081 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-65f9545a-baa6-4db9-a106-c67245bd7a1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:33.316533 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-65f9545a-baa6-4db9-a106-c67245bd7a1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:33.317316 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-65f9545a-baa6-4db9-a106-c67245bd7a1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:33.317792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-65f9545a-baa6-4db9-a106-c67245bd7a1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:33.323011 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:33.531078 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-65f9545a-baa6-4db9-a106-c67245bd7a1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:33.538554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-65f9545a-baa6-4db9-a106-c67245bd7a1f tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1505 microversion: 2.1 time: 0.234957 Jun 17 07:44:33.539231 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 458/929] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:33 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:33.864911 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2fd4acbf-d2c3-4da5-9d32-788aa6f6d6cb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:33.865655 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2fd4acbf-d2c3-4da5-9d32-788aa6f6d6cb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:33.872711 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2fd4acbf-d2c3-4da5-9d32-788aa6f6d6cb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:33.879570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2fd4acbf-d2c3-4da5-9d32-788aa6f6d6cb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:33.879570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2fd4acbf-d2c3-4da5-9d32-788aa6f6d6cb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:33.879570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2fd4acbf-d2c3-4da5-9d32-788aa6f6d6cb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:34.019815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2fd4acbf-d2c3-4da5-9d32-788aa6f6d6cb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:34.023580 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:34.028870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2fd4acbf-d2c3-4da5-9d32-788aa6f6d6cb tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1278 microversion: 2.1 time: 0.168344 Jun 17 07:44:34.029817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 472/930] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:33 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:34.252654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-ebf2edf4-c143-4434-bc37-e6e5becb7609 req-2a2e059c-7c20-4759-8ae0-269d3e9d5942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6def01-9ebf-4b6c-a559-59f912178f66", "tag": "4c771250-5a6d-4b03-9b41-002f7edfd23a"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:34.262747 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-ebf2edf4-c143-4434-bc37-e6e5becb7609 req-2a2e059c-7c20-4759-8ae0-269d3e9d5942 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:34.263190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-ebf2edf4-c143-4434-bc37-e6e5becb7609 req-2a2e059c-7c20-4759-8ae0-269d3e9d5942 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:34.281508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-ebf2edf4-c143-4434-bc37-e6e5becb7609 req-2a2e059c-7c20-4759-8ae0-269d3e9d5942 service nova] Creating event network-changed:4c771250-5a6d-4b03-9b41-002f7edfd23a for instance fd6def01-9ebf-4b6c-a559-59f912178f66 on hv-cinder-79733 Jun 17 07:44:34.286500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-ebf2edf4-c143-4434-bc37-e6e5becb7609 req-2a2e059c-7c20-4759-8ae0-269d3e9d5942 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041399 Jun 17 07:44:34.292258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 459/931] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:44:34.556284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6750d38b-8617-47f5-9faa-762035d9a135 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:34.556967 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6750d38b-8617-47f5-9faa-762035d9a135 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:34.563164 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6750d38b-8617-47f5-9faa-762035d9a135 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:34.563633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6750d38b-8617-47f5-9faa-762035d9a135 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:34.564380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6750d38b-8617-47f5-9faa-762035d9a135 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:34.564806 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6750d38b-8617-47f5-9faa-762035d9a135 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:34.700709 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6750d38b-8617-47f5-9faa-762035d9a135 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:34.708109 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6750d38b-8617-47f5-9faa-762035d9a135 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1505 microversion: 2.1 time: 0.156100 Jun 17 07:44:34.708668 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 473/932] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:34 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:35.047117 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a5277215-fede-47fd-b901-95fd43634f87 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:35.047992 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a5277215-fede-47fd-b901-95fd43634f87 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:35.054414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5277215-fede-47fd-b901-95fd43634f87 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:35.054866 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5277215-fede-47fd-b901-95fd43634f87 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:35.055699 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5277215-fede-47fd-b901-95fd43634f87 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:35.056233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a5277215-fede-47fd-b901-95fd43634f87 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:35.187069 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a5277215-fede-47fd-b901-95fd43634f87 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:35.194470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a5277215-fede-47fd-b901-95fd43634f87 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.151627 Jun 17 07:44:35.195033 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 460/933] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:35 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:35.455432 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8ba224c1-b203-4c3b-83ae-7c47bfcf9e91 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:35.456361 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8ba224c1-b203-4c3b-83ae-7c47bfcf9e91 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:35.463517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8ba224c1-b203-4c3b-83ae-7c47bfcf9e91 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:35.464394 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8ba224c1-b203-4c3b-83ae-7c47bfcf9e91 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:35.466023 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8ba224c1-b203-4c3b-83ae-7c47bfcf9e91 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:35.466023 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8ba224c1-b203-4c3b-83ae-7c47bfcf9e91 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:35.491790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8ba224c1-b203-4c3b-83ae-7c47bfcf9e91 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/ips" status: 200 len: 151 microversion: 2.20 time: 0.040805 Jun 17 07:44:35.492496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 474/934] 10.222.0.52 () {60 vars in 1288 bytes} [Fri Jun 17 07:44:35 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:44:35.728156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cd6b9ae6-f64b-49ed-9f35-81c9b25beb75 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:35.728156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cd6b9ae6-f64b-49ed-9f35-81c9b25beb75 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:35.735123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cd6b9ae6-f64b-49ed-9f35-81c9b25beb75 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:35.735705 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cd6b9ae6-f64b-49ed-9f35-81c9b25beb75 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:35.736549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cd6b9ae6-f64b-49ed-9f35-81c9b25beb75 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:35.737061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cd6b9ae6-f64b-49ed-9f35-81c9b25beb75 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:35.979064 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cd6b9ae6-f64b-49ed-9f35-81c9b25beb75 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:35.990305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cd6b9ae6-f64b-49ed-9f35-81c9b25beb75 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1505 microversion: 2.1 time: 0.267637 Jun 17 07:44:36.000936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 461/935] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:35 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:36.155305 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:44:36.155775 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Fri Jun 17 07:44:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:44:36.212201 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-deb8219d-d747-46dd-83a0-5a51a60247d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:36.213368 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-deb8219d-d747-46dd-83a0-5a51a60247d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:36.220124 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-deb8219d-d747-46dd-83a0-5a51a60247d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:36.224994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-deb8219d-d747-46dd-83a0-5a51a60247d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:36.224994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-deb8219d-d747-46dd-83a0-5a51a60247d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:36.224994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-deb8219d-d747-46dd-83a0-5a51a60247d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:36.391515 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-deb8219d-d747-46dd-83a0-5a51a60247d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:36.399211 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-deb8219d-d747-46dd-83a0-5a51a60247d0 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.191071 Jun 17 07:44:36.400347 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 475/936] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:36 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:36.583359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-82dbe206-4036-4041-af3a-f48b66897eb0 req-8a255ab8-0bc5-4b85-9c3d-78a9307a7015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351d4b96-9767-4002-be54-c8b9d8bfaf9f", "name": "network-vif-deleted", "tag": "8d8a89ec-790c-499d-a109-8b3365f52d24"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:36.592458 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-82dbe206-4036-4041-af3a-f48b66897eb0 req-8a255ab8-0bc5-4b85-9c3d-78a9307a7015 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:36.592909 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-82dbe206-4036-4041-af3a-f48b66897eb0 req-8a255ab8-0bc5-4b85-9c3d-78a9307a7015 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:36.606386 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-82dbe206-4036-4041-af3a-f48b66897eb0 req-8a255ab8-0bc5-4b85-9c3d-78a9307a7015 service nova] Creating event network-vif-deleted:8d8a89ec-790c-499d-a109-8b3365f52d24 for instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f on hv-cinder-79733 Jun 17 07:44:36.611578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-82dbe206-4036-4041-af3a-f48b66897eb0 req-8a255ab8-0bc5-4b85-9c3d-78a9307a7015 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031964 Jun 17 07:44:36.612195 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 462/937] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:44:37.008153 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-605b456c-976d-40d0-b857-54bfd70c11a9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:37.008746 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-605b456c-976d-40d0-b857-54bfd70c11a9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:37.015751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-605b456c-976d-40d0-b857-54bfd70c11a9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:37.016203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-605b456c-976d-40d0-b857-54bfd70c11a9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:37.016959 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-605b456c-976d-40d0-b857-54bfd70c11a9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:37.017413 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-605b456c-976d-40d0-b857-54bfd70c11a9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:37.088485 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-605b456c-976d-40d0-b857-54bfd70c11a9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:37.095851 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-605b456c-976d-40d0-b857-54bfd70c11a9 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1463 microversion: 2.1 time: 0.091648 Jun 17 07:44:37.096426 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 476/938] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:37 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:37.227257 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-944c0e7d-b189-4a31-a218-6f94bc01dbb5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:37.228512 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-944c0e7d-b189-4a31-a218-6f94bc01dbb5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:37.235706 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-944c0e7d-b189-4a31-a218-6f94bc01dbb5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:37.236158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-944c0e7d-b189-4a31-a218-6f94bc01dbb5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:37.236926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-944c0e7d-b189-4a31-a218-6f94bc01dbb5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:37.237387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-944c0e7d-b189-4a31-a218-6f94bc01dbb5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:37.262566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-944c0e7d-b189-4a31-a218-6f94bc01dbb5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:44:37.417686 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2a80f783-53d5-4e81-91b2-1e7eea8a58b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:37.418239 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2a80f783-53d5-4e81-91b2-1e7eea8a58b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:37.424243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a80f783-53d5-4e81-91b2-1e7eea8a58b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:37.424691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a80f783-53d5-4e81-91b2-1e7eea8a58b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:37.425474 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a80f783-53d5-4e81-91b2-1e7eea8a58b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:37.425910 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2a80f783-53d5-4e81-91b2-1e7eea8a58b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:37.566019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-944c0e7d-b189-4a31-a218-6f94bc01dbb5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 204 len: 0 microversion: 2.1 time: 0.343282 Jun 17 07:44:37.567261 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 463/939] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:44:37 2022] DELETE /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:44:37.573222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2a80f783-53d5-4e81-91b2-1e7eea8a58b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:37.578181 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c307c38c-684b-4d91-80e5-82f999d434ff tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:37.579216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c307c38c-684b-4d91-80e5-82f999d434ff tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:37.581027 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2a80f783-53d5-4e81-91b2-1e7eea8a58b5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.168004 Jun 17 07:44:37.581866 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 477/940] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:37 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:37.591678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c307c38c-684b-4d91-80e5-82f999d434ff tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:37.592123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c307c38c-684b-4d91-80e5-82f999d434ff tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:37.592963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c307c38c-684b-4d91-80e5-82f999d434ff tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:37.593632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c307c38c-684b-4d91-80e5-82f999d434ff tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:37.733982 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c307c38c-684b-4d91-80e5-82f999d434ff tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:37.743163 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c307c38c-684b-4d91-80e5-82f999d434ff tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.171429 Jun 17 07:44:37.743786 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 464/941] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:37 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:38.114135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-46b2a143-64e5-4c13-b816-5de35490890e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:38.114832 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-46b2a143-64e5-4c13-b816-5de35490890e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:38.116872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:38.123375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46b2a143-64e5-4c13-b816-5de35490890e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.123833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46b2a143-64e5-4c13-b816-5de35490890e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.124597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46b2a143-64e5-4c13-b816-5de35490890e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.125032 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46b2a143-64e5-4c13-b816-5de35490890e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.192323 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-46b2a143-64e5-4c13-b816-5de35490890e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:38.202707 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-46b2a143-64e5-4c13-b816-5de35490890e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1299 microversion: 2.1 time: 0.091906 Jun 17 07:44:38.213132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 478/942] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:38 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:38.599067 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0d5f6b8b-c976-4d1a-b0c3-7e7949c8670e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:38.599655 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0d5f6b8b-c976-4d1a-b0c3-7e7949c8670e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:38.606646 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d5f6b8b-c976-4d1a-b0c3-7e7949c8670e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.607089 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d5f6b8b-c976-4d1a-b0c3-7e7949c8670e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.607856 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d5f6b8b-c976-4d1a-b0c3-7e7949c8670e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.608268 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d5f6b8b-c976-4d1a-b0c3-7e7949c8670e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.743046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0d5f6b8b-c976-4d1a-b0c3-7e7949c8670e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:38.751454 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0d5f6b8b-c976-4d1a-b0c3-7e7949c8670e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.156307 Jun 17 07:44:38.752018 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 465/943] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:38 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:38.760530 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1a8deb36-6e3f-49aa-8df9-b8c36ea478e5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:38.761149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1a8deb36-6e3f-49aa-8df9-b8c36ea478e5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:38.763005 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=8 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:38.767828 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1a8deb36-6e3f-49aa-8df9-b8c36ea478e5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.768271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1a8deb36-6e3f-49aa-8df9-b8c36ea478e5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.769214 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1a8deb36-6e3f-49aa-8df9-b8c36ea478e5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.769728 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1a8deb36-6e3f-49aa-8df9-b8c36ea478e5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.846988 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-96a47d5f-c631-4994-bc4b-19ca061167ac req-faf4e50b-0927-45f3-8caf-1f315d08afe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a5406c-f3f3-41ee-b763-cfcabfa91915", "tag": "745661a1-a356-4257-97ca-68167916d2cd"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:38.856475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-96a47d5f-c631-4994-bc4b-19ca061167ac req-faf4e50b-0927-45f3-8caf-1f315d08afe9 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.856837 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-96a47d5f-c631-4994-bc4b-19ca061167ac req-faf4e50b-0927-45f3-8caf-1f315d08afe9 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.869144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-96a47d5f-c631-4994-bc4b-19ca061167ac req-faf4e50b-0927-45f3-8caf-1f315d08afe9 service nova] Creating event network-changed:745661a1-a356-4257-97ca-68167916d2cd for instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 on hv-cinder-79733 Jun 17 07:44:38.875945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-96a47d5f-c631-4994-bc4b-19ca061167ac req-faf4e50b-0927-45f3-8caf-1f315d08afe9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032322 Jun 17 07:44:38.876446 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 466/944] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:44:38.911099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-200cefed-a787-439a-9bb8-67708224c01e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:38.911778 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-200cefed-a787-439a-9bb8-67708224c01e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:38.917043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1a8deb36-6e3f-49aa-8df9-b8c36ea478e5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:38.918753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-200cefed-a787-439a-9bb8-67708224c01e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.919265 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-200cefed-a787-439a-9bb8-67708224c01e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.920232 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-200cefed-a787-439a-9bb8-67708224c01e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:38.920592 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-200cefed-a787-439a-9bb8-67708224c01e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:38.925614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1a8deb36-6e3f-49aa-8df9-b8c36ea478e5 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.169536 Jun 17 07:44:38.926211 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 479/945] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:38 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:38.947741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-200cefed-a787-439a-9bb8-67708224c01e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lazy-loading 'flavor' on Instance uuid 871cb913-ba89-4924-8a2c-ad61a797c36b {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:44:39.220174 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:39.220783 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:39.227300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.231026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:39.231026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.231026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:39.261509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.261956 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:39.262411 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lazy-loading 'fault' on Instance uuid 351d4b96-9767-4002-be54-c8b9d8bfaf9f {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:44:39.305230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be176511fa34aa6aa5fe83bc6a2b163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe594d24d9843acbec2e846c98c14ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:39.313064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c2e3679b-7660-4ae7-85d1-c1aaf98f6fa6 tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 200 len: 1304 microversion: 2.1 time: 0.096739 Jun 17 07:44:39.313671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 480/946] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:39 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:39.547877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-200cefed-a787-439a-9bb8-67708224c01e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/action" status: 202 len: 0 microversion: 2.20 time: 0.640954 Jun 17 07:44:39.548560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 467/947] 10.222.0.52 () {62 vars in 1318 bytes} [Fri Jun 17 07:44:38 2022] POST /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:44:39.559282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:39.559282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:39.563930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.564375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:39.565550 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.565981 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:39.728797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:39.737500 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:39.739055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:39.740210 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a046c947-6978-47f3-9fed-b2ce66b5af81 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.187333 Jun 17 07:44:39.740801 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 481/948] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:39 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:39.769340 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6c1cd5a0-22e1-47c3-92f3-456a7cce04b3 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:39.770072 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6c1cd5a0-22e1-47c3-92f3-456a7cce04b3 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:39.777118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c1cd5a0-22e1-47c3-92f3-456a7cce04b3 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.777600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c1cd5a0-22e1-47c3-92f3-456a7cce04b3 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:39.778366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c1cd5a0-22e1-47c3-92f3-456a7cce04b3 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.778807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c1cd5a0-22e1-47c3-92f3-456a7cce04b3 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:39.912632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6c1cd5a0-22e1-47c3-92f3-456a7cce04b3 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:39.920061 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6c1cd5a0-22e1-47c3-92f3-456a7cce04b3 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.155441 Jun 17 07:44:39.920680 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 468/949] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:39 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:39.943141 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3e32197a-baee-49ba-be20-94800ffd6646 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:39.943770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3e32197a-baee-49ba-be20-94800ffd6646 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:39.950288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e32197a-baee-49ba-be20-94800ffd6646 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.950748 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e32197a-baee-49ba-be20-94800ffd6646 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:39.951506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e32197a-baee-49ba-be20-94800ffd6646 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:39.951932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3e32197a-baee-49ba-be20-94800ffd6646 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:40.116230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3e32197a-baee-49ba-be20-94800ffd6646 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:40.124610 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3e32197a-baee-49ba-be20-94800ffd6646 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1569 microversion: 2.1 time: 0.185328 Jun 17 07:44:40.125174 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 482/950] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:39 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:40.333636 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:40.334339 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] [instance: 351d4b96-9767-4002-be54-c8b9d8bfaf9f] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:40.341222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:40.343873 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:40.343873 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:40.343873 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:40.360018 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] HTTP exception thrown: Instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f could not be found. Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Request method failure captured: Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f HTTP/1.1 Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDC2-LS7EpN_9_g2C6PQAtCC9Vrf7BADVUtuhIUL3Rx0KLYqRZNtrSvI1_6aYi_1yAG0enXy1o9SFUtkfyf66agyZU4sgrf0oOM82lC3hyf4K3RFQAEQhfIjXv3uWUAeDipQuEmQ6QQ9oEQvWLkNPliKAB56bHJxsb0GeE5NHBbtfGI Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 5fe594d24d9843acbec2e846c98c14ae Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-VolumesActionsTest-1232333641 Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:44:40.361593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5fe594d24d9843acbec2e846c98c14ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fe594d24d9843acbec2e846c98c14ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5fe594d24d9843acbec2e846c98c14ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5fe594d24d9843acbec2e846c98c14ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-VolumesActionsTest-1232333641 Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 5fe594d24d9843acbec2e846c98c14ae Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-VolumesActionsTest-1232333641 Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-VolumesActionsTest-1232333641-project Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 8be176511fa34aa6aa5fe83bc6a2b163 Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-VolumesActionsTest-1232333641-project Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f could not be found. Jun 17 07:44:40.363341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '351d4b96-9767-4002-be54-c8b9d8bfaf9f'} Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f could not be found. Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:44:40.364162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f could not be found. Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f could not be found. Jun 17 07:44:40.366055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:44:40.367218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] Returning 404 to user: Instance 351d4b96-9767-4002-be54-c8b9d8bfaf9f could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:44:40.367218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e2ced005-43c7-4b28-bfd8-d7952b828b0e tempest-VolumesActionsTest-1232333641 tempest-VolumesActionsTest-1232333641-project] 10.222.0.52 "GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f" status: 404 len: 111 microversion: 2.1 time: 0.035263 Jun 17 07:44:40.372169 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 469/951] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:40 2022] GET /compute/v2.1/servers/351d4b96-9767-4002-be54-c8b9d8bfaf9f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:44:40.672876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-4b1b01ff-224e-4f56-9ded-d6957be83b3d req-f7c7acd3-cb8e-458a-bef7-70c437758d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a5406c-f3f3-41ee-b763-cfcabfa91915", "name": "network-vif-deleted", "tag": "745661a1-a356-4257-97ca-68167916d2cd"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:40.681917 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-4b1b01ff-224e-4f56-9ded-d6957be83b3d req-f7c7acd3-cb8e-458a-bef7-70c437758d73 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:40.682355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-4b1b01ff-224e-4f56-9ded-d6957be83b3d req-f7c7acd3-cb8e-458a-bef7-70c437758d73 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:40.693978 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-4b1b01ff-224e-4f56-9ded-d6957be83b3d req-f7c7acd3-cb8e-458a-bef7-70c437758d73 service nova] Creating event network-vif-deleted:745661a1-a356-4257-97ca-68167916d2cd for instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 on hv-cinder-79733 Jun 17 07:44:40.699525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-4b1b01ff-224e-4f56-9ded-d6957be83b3d req-f7c7acd3-cb8e-458a-bef7-70c437758d73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 Jun 17 07:44:40.700316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 483/952] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:44:40.759539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:40.759539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:40.765560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:40.766003 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:40.767113 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:40.767721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:40.900605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:40.908505 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:40.910205 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:40.911366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b93743e2-a177-470f-890a-f1d8fc412176 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.157314 Jun 17 07:44:40.911927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 470/953] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:40 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:40.939565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0a7a2624-b437-446c-bdfb-7312f0d7bcbe tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:40.940265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0a7a2624-b437-446c-bdfb-7312f0d7bcbe tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:40.947989 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0a7a2624-b437-446c-bdfb-7312f0d7bcbe tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:40.948309 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0a7a2624-b437-446c-bdfb-7312f0d7bcbe tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:40.949574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0a7a2624-b437-446c-bdfb-7312f0d7bcbe tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:40.950245 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0a7a2624-b437-446c-bdfb-7312f0d7bcbe tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:41.101252 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0a7a2624-b437-446c-bdfb-7312f0d7bcbe tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:41.109779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0a7a2624-b437-446c-bdfb-7312f0d7bcbe tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.177456 Jun 17 07:44:41.110355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 484/954] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:40 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:41.144087 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c79857ad-d6a4-4740-b4d0-751d2bb7ce6d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:41.145024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c79857ad-d6a4-4740-b4d0-751d2bb7ce6d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:41.152752 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c79857ad-d6a4-4740-b4d0-751d2bb7ce6d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:41.153560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c79857ad-d6a4-4740-b4d0-751d2bb7ce6d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:41.154539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c79857ad-d6a4-4740-b4d0-751d2bb7ce6d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:41.155094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c79857ad-d6a4-4740-b4d0-751d2bb7ce6d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:41.222849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c79857ad-d6a4-4740-b4d0-751d2bb7ce6d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:41.231929 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c79857ad-d6a4-4740-b4d0-751d2bb7ce6d tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1219 microversion: 2.1 time: 0.091785 Jun 17 07:44:41.232494 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 471/955] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:41 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:41.930571 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:41.931171 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:41.938494 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:41.938942 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:41.939685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:41.940107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:42.078211 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:42.085150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:42.086763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:42.088533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-449918ad-0e3e-459b-adba-39776d7c00aa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.161278 Jun 17 07:44:42.089192 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 485/956] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:41 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:42.126999 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d9c6c2dd-bd32-47c0-9670-7e3043148eaa tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:42.127620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d9c6c2dd-bd32-47c0-9670-7e3043148eaa tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:42.134015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9c6c2dd-bd32-47c0-9670-7e3043148eaa tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:42.134456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9c6c2dd-bd32-47c0-9670-7e3043148eaa tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:42.135285 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9c6c2dd-bd32-47c0-9670-7e3043148eaa tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:42.135830 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d9c6c2dd-bd32-47c0-9670-7e3043148eaa tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:42.249251 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:42.250143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:42.256255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:42.256704 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:42.257501 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:42.257935 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:42.276490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d9c6c2dd-bd32-47c0-9670-7e3043148eaa tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:42.283496 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d9c6c2dd-bd32-47c0-9670-7e3043148eaa tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.160295 Jun 17 07:44:42.284081 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 472/957] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:42 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:42.288033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:42.292398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:42.292835 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:42.293277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lazy-loading 'fault' on Instance uuid d0a5406c-f3f3-41ee-b763-cfcabfa91915 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:44:42.334606 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:42.342880 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5cbd45ce-358a-4b3a-b53c-e8c6fc2241da tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1224 microversion: 2.1 time: 0.098769 Jun 17 07:44:42.343534 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 486/958] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:42 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:43.107002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:43.107609 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:43.113610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:43.114060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:43.114815 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:43.115251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:43.243654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:43.247715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:43.252498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:43.254038 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:43.263753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-95c3c522-d76d-4874-b368-dd6a12c3edb1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.152420 Jun 17 07:44:43.263753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 473/959] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:43 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:43.300297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-912a1c51-183c-4b00-a6dc-16f9c9eda93f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:43.300899 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-912a1c51-183c-4b00-a6dc-16f9c9eda93f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:43.307820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-912a1c51-183c-4b00-a6dc-16f9c9eda93f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:43.308260 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-912a1c51-183c-4b00-a6dc-16f9c9eda93f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:43.309014 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-912a1c51-183c-4b00-a6dc-16f9c9eda93f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:43.309471 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-912a1c51-183c-4b00-a6dc-16f9c9eda93f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:43.362534 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:43.363054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:43.370084 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:43.370536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:43.371842 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:43.372258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:43.405221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:43.405794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:43.406349 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lazy-loading 'fault' on Instance uuid d0a5406c-f3f3-41ee-b763-cfcabfa91915 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:44:43.447324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-912a1c51-183c-4b00-a6dc-16f9c9eda93f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:43.450745 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:43.455881 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-912a1c51-183c-4b00-a6dc-16f9c9eda93f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.159338 Jun 17 07:44:43.456581 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 487/960] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:43 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:43.457981 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5964240a-bc5b-42ac-8885-8ae280ba0468 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1224 microversion: 2.1 time: 0.099490 Jun 17 07:44:43.458535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 474/961] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:43 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:44.272660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:44.273254 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:44.279392 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:44.279834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:44.280613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:44.281045 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:44.414375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:44.422860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:44.424350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:44.425525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-77a9ab00-3a24-4e13-9c24-82e64ab3d0d9 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.156729 Jun 17 07:44:44.426088 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 488/962] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:44 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:44.473727 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-752265a9-f9bd-4c77-bee1-3849f7fcfb21 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:44.474428 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-752265a9-f9bd-4c77-bee1-3849f7fcfb21 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:44.475413 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:44.476071 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:44.481666 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-752265a9-f9bd-4c77-bee1-3849f7fcfb21 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:44.482126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-752265a9-f9bd-4c77-bee1-3849f7fcfb21 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:44.482873 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-752265a9-f9bd-4c77-bee1-3849f7fcfb21 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:44.483304 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-752265a9-f9bd-4c77-bee1-3849f7fcfb21 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:44.483774 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:44.484230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:44.484972 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:44.485428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:44.516666 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:44.517107 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:44.517576 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lazy-loading 'fault' on Instance uuid d0a5406c-f3f3-41ee-b763-cfcabfa91915 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:44:44.520204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:44.559367 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:44.566771 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8d39828b-e6b0-4768-ae3c-24293a051993 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1224 microversion: 2.1 time: 0.095200 Jun 17 07:44:44.567329 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 489/963] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:44 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:44.620654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-752265a9-f9bd-4c77-bee1-3849f7fcfb21 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:44.628236 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-752265a9-f9bd-4c77-bee1-3849f7fcfb21 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.158462 Jun 17 07:44:44.628851 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 475/964] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:44 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:45.444152 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:45.444737 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:45.452008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:45.452448 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:45.453194 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:45.453654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:45.580798 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:45.583370 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:45.583984 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:45.589588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:45.590492 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:45.590945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:45.591151 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:45.591715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:45.592148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:45.592315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-104dfd83-5e67-4004-aac8-3c56f6c0caf7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.152202 Jun 17 07:44:45.592877 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 490/965] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:45 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:45.622940 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:45.623376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:45.623815 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lazy-loading 'fault' on Instance uuid d0a5406c-f3f3-41ee-b763-cfcabfa91915 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:44:45.646776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-24225030-1a10-4ba0-bbab-5cc23b04bd56 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:45.647381 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-24225030-1a10-4ba0-bbab-5cc23b04bd56 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:45.653371 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24225030-1a10-4ba0-bbab-5cc23b04bd56 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:45.653818 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24225030-1a10-4ba0-bbab-5cc23b04bd56 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:45.654572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24225030-1a10-4ba0-bbab-5cc23b04bd56 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:45.655006 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24225030-1a10-4ba0-bbab-5cc23b04bd56 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:45.665743 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e9fc215b64a44c2b989e68c788c1534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de5c6b438594f4eae8e7010ccf0ca65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:45.674470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b7a32745-ee9d-4329-a93b-c64a1b361b24 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 200 len: 1224 microversion: 2.1 time: 0.094813 Jun 17 07:44:45.675054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 476/966] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:45 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:45.790284 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-24225030-1a10-4ba0-bbab-5cc23b04bd56 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:45.798592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-24225030-1a10-4ba0-bbab-5cc23b04bd56 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.155801 Jun 17 07:44:45.799161 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 491/967] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:45 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:46.610709 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:46.611370 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:46.617843 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:46.618285 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:46.619063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:46.619503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:46.691879 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:46.692480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] [instance: d0a5406c-f3f3-41ee-b763-cfcabfa91915] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:46.700162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:46.700578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:46.701395 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:46.701830 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:46.716689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] HTTP exception thrown: Instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 could not be found. Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Request method failure captured: Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 HTTP/1.1 Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC9ZgcItUXDay2ZF9-oke_DxkDXyUrIUVEvQID6cZ1bAaIFNzaxNIenezNHEZTwNR9uzu37zTAvFCrAYy-wkv-f-AG9g44va0s-4re-x5iGHXvvUNvcaFckFxqXAIzb6carHOTLxX-FJUqQnzMiHH8tGXO1sWTa1uaPfvsGWfRb5tnE Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 5de5c6b438594f4eae8e7010ccf0ca65 Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-TestShelveInstance-607834607 Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:44:46.718433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5de5c6b438594f4eae8e7010ccf0ca65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5de5c6b438594f4eae8e7010ccf0ca65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5de5c6b438594f4eae8e7010ccf0ca65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5de5c6b438594f4eae8e7010ccf0ca65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-TestShelveInstance-607834607 Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 5de5c6b438594f4eae8e7010ccf0ca65 Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-TestShelveInstance-607834607 Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-TestShelveInstance-607834607-project Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 5e9fc215b64a44c2b989e68c788c1534 Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-TestShelveInstance-607834607-project Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 could not be found. Jun 17 07:44:46.720074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'd0a5406c-f3f3-41ee-b763-cfcabfa91915'} Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 could not be found. Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:44:46.720999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 could not be found. Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 could not be found. Jun 17 07:44:46.722456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:44:46.723562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Returning 404 to user: Instance d0a5406c-f3f3-41ee-b763-cfcabfa91915 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:44:46.723562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9eae6297-5351-4cd0-9482-6f1278cdc824 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915" status: 404 len: 111 microversion: 2.1 time: 0.031816 Jun 17 07:44:46.723872 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 492/968] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:46 2022] GET /compute/v2.1/servers/d0a5406c-f3f3-41ee-b763-cfcabfa91915 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:44:46.756932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:46.765594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:46.767080 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:46.768233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6d12881c-ca3b-4bab-bc73-f423f44bf978 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.161515 Jun 17 07:44:46.768879 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 477/969] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:46 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:46.815876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-025d92eb-7cf9-429d-99e5-22c688091c7b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:46.816476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-025d92eb-7cf9-429d-99e5-22c688091c7b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:46.822484 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-025d92eb-7cf9-429d-99e5-22c688091c7b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:46.822934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-025d92eb-7cf9-429d-99e5-22c688091c7b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:46.823752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-025d92eb-7cf9-429d-99e5-22c688091c7b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:46.824281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-025d92eb-7cf9-429d-99e5-22c688091c7b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:46.961959 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-025d92eb-7cf9-429d-99e5-22c688091c7b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:46.970101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-025d92eb-7cf9-429d-99e5-22c688091c7b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.158013 Jun 17 07:44:46.970654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 493/970] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:46 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:47.024504 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b070be3e-a00a-4ba1-aae7-82dcae0ff607 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] Calling method '.version_select at 0x7fb069afd5e0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:47.122060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b070be3e-a00a-4ba1-aae7-82dcae0ff607 tempest-TestShelveInstance-607834607 tempest-TestShelveInstance-607834607-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-664717037" status: 202 len: 0 microversion: 2.1 time: 0.101331 Jun 17 07:44:47.122694 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 478/971] 10.222.0.52 () {58 vars in 1250 bytes} [Fri Jun 17 07:44:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-664717037 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:44:47.787493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:47.788141 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:47.794997 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:47.795446 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:47.796221 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:47.796655 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:47.987400 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-51fed4fc-b6dc-41d0-8e0b-421dea4b9b9d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:47.988198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-51fed4fc-b6dc-41d0-8e0b-421dea4b9b9d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:47.994790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51fed4fc-b6dc-41d0-8e0b-421dea4b9b9d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:47.996108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51fed4fc-b6dc-41d0-8e0b-421dea4b9b9d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:47.997003 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51fed4fc-b6dc-41d0-8e0b-421dea4b9b9d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:47.997478 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51fed4fc-b6dc-41d0-8e0b-421dea4b9b9d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:48.016060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:48.024263 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:48.025791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:48.027437 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4294deaa-feea-45f6-916a-3553c04fe419 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.243745 Jun 17 07:44:48.028227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 494/972] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:47 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:48.132501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-51fed4fc-b6dc-41d0-8e0b-421dea4b9b9d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:48.140876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-51fed4fc-b6dc-41d0-8e0b-421dea4b9b9d tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.157386 Jun 17 07:44:48.141471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 479/973] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:47 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:49.045956 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:49.046505 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:49.053288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:49.054052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:49.054821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:49.055251 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:49.158027 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1dbb78a7-66b5-424c-81c0-dc991cb7b9c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:49.158824 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1dbb78a7-66b5-424c-81c0-dc991cb7b9c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:49.190280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1dbb78a7-66b5-424c-81c0-dc991cb7b9c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:49.192064 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1dbb78a7-66b5-424c-81c0-dc991cb7b9c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:49.194228 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1dbb78a7-66b5-424c-81c0-dc991cb7b9c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:49.195446 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1dbb78a7-66b5-424c-81c0-dc991cb7b9c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:49.262078 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:49.271780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:49.273753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:49.274970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1b01a0a5-fb3e-4548-81b0-a9aee0463601 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.233271 Jun 17 07:44:49.276536 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 495/974] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:49 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:49.494212 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1dbb78a7-66b5-424c-81c0-dc991cb7b9c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:49.503520 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1dbb78a7-66b5-424c-81c0-dc991cb7b9c9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.349684 Jun 17 07:44:49.506647 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 480/975] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:49 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:44:50.295472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:50.296197 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:50.303685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:50.304456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:50.306832 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:50.308305 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:50.481191 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:50.490384 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:50.502516 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:50.506716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-27a6c131-79d4-4056-99ff-acce83d7d74c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.215063 Jun 17 07:44:50.521575 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 496/976] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:50 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:50.523065 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6c1093b4-fbbb-4fe0-8684-002ad5d9218e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:50.523910 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6c1093b4-fbbb-4fe0-8684-002ad5d9218e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:50.534792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c1093b4-fbbb-4fe0-8684-002ad5d9218e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:50.535417 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c1093b4-fbbb-4fe0-8684-002ad5d9218e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:50.536456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c1093b4-fbbb-4fe0-8684-002ad5d9218e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:50.536983 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6c1093b4-fbbb-4fe0-8684-002ad5d9218e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:50.853433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6c1093b4-fbbb-4fe0-8684-002ad5d9218e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:50.863947 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6c1093b4-fbbb-4fe0-8684-002ad5d9218e tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.344629 Jun 17 07:44:50.873815 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 481/977] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:50 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:51.528428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:51.529062 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:51.549874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:51.551770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:51.564663 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:51.566826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:51.859613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:51.882594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-84ba5271-4923-40b9-98db-6bc729f3fee9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:51.883203 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-84ba5271-4923-40b9-98db-6bc729f3fee9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:51.890238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:44:51.915565 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-84ba5271-4923-40b9-98db-6bc729f3fee9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:51.917304 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-84ba5271-4923-40b9-98db-6bc729f3fee9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:51.918615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-84ba5271-4923-40b9-98db-6bc729f3fee9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:51.919678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-84ba5271-4923-40b9-98db-6bc729f3fee9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:51.928204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:51.944999 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:51.946241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-792a9d9a-1fbc-4a40-8dfd-943214fdcca2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.422522 Jun 17 07:44:51.946800 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 497/978] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:51 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:52.156923 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-84ba5271-4923-40b9-98db-6bc729f3fee9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:52.166210 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-84ba5271-4923-40b9-98db-6bc729f3fee9 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.287999 Jun 17 07:44:52.167841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 482/979] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:51 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:52.988434 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:52.989082 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:52.997450 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:53.002473 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:53.002473 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:53.002473 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:53.186125 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-23dd05e9-8392-40be-bf27-f201666620e8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:53.191904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-23dd05e9-8392-40be-bf27-f201666620e8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:53.193904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-23dd05e9-8392-40be-bf27-f201666620e8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:53.194357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-23dd05e9-8392-40be-bf27-f201666620e8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:53.195141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-23dd05e9-8392-40be-bf27-f201666620e8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:53.195578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-23dd05e9-8392-40be-bf27-f201666620e8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:53.231015 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:53.246779 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:53.248936 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:53.250397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-885d683b-8772-4738-a6b8-c9c39c497910 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.268177 Jun 17 07:44:53.254945 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 498/980] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:52 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:53.287078 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-5cb6de6d-421f-488e-ac13-ffe7f3b6f1b5 req-6839434d-6b08-4c31-b982-79b7028b8f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6def01-9ebf-4b6c-a559-59f912178f66", "name": "network-vif-plugged", "status": "completed", "tag": "4c771250-5a6d-4b03-9b41-002f7edfd23a"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:44:53.299663 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-5cb6de6d-421f-488e-ac13-ffe7f3b6f1b5 req-6839434d-6b08-4c31-b982-79b7028b8f22 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:53.300509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-5cb6de6d-421f-488e-ac13-ffe7f3b6f1b5 req-6839434d-6b08-4c31-b982-79b7028b8f22 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:53.314098 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-5cb6de6d-421f-488e-ac13-ffe7f3b6f1b5 req-6839434d-6b08-4c31-b982-79b7028b8f22 service nova] Creating event network-vif-plugged:4c771250-5a6d-4b03-9b41-002f7edfd23a for instance fd6def01-9ebf-4b6c-a559-59f912178f66 on hv-cinder-79733 Jun 17 07:44:53.319523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-5cb6de6d-421f-488e-ac13-ffe7f3b6f1b5 req-6839434d-6b08-4c31-b982-79b7028b8f22 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040351 Jun 17 07:44:53.320433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 499/981] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:44:53.637912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-23dd05e9-8392-40be-bf27-f201666620e8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:53.649613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-23dd05e9-8392-40be-bf27-f201666620e8 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.468900 Jun 17 07:44:53.653167 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 483/982] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:53 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:54.329451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:54.329451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:54.329451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:54.329451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:54.330331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:54.330331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:54.556051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:54.566010 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:54.568195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:54.569702 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e7ba217d-73b3-49ec-918d-b0e1d1bff09e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.298598 Jun 17 07:44:54.570795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 500/983] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:54 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:54.694723 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fc3a1e77-6c41-4a0d-ac06-3214377cbd70 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:54.700049 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fc3a1e77-6c41-4a0d-ac06-3214377cbd70 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:54.716104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc3a1e77-6c41-4a0d-ac06-3214377cbd70 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:54.717380 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc3a1e77-6c41-4a0d-ac06-3214377cbd70 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:54.718608 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc3a1e77-6c41-4a0d-ac06-3214377cbd70 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:54.719176 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc3a1e77-6c41-4a0d-ac06-3214377cbd70 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:54.977535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fc3a1e77-6c41-4a0d-ac06-3214377cbd70 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:54.988448 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fc3a1e77-6c41-4a0d-ac06-3214377cbd70 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.317981 Jun 17 07:44:54.992451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 484/984] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:54 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:55.595410 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:55.596032 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:55.609549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:55.610006 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:55.611900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:55.613350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:55.842758 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:55.855677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:55.856988 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:55.858502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8486f30e-37f8-4158-b31a-2d487e15bcd0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.267165 Jun 17 07:44:55.859067 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 501/985] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:55 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:56.008376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8b34d4c4-6d17-4ada-865c-0a93c672f97f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:56.008997 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8b34d4c4-6d17-4ada-865c-0a93c672f97f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:56.015878 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8b34d4c4-6d17-4ada-865c-0a93c672f97f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:56.016349 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8b34d4c4-6d17-4ada-865c-0a93c672f97f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:56.017114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8b34d4c4-6d17-4ada-865c-0a93c672f97f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:56.017595 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8b34d4c4-6d17-4ada-865c-0a93c672f97f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:56.155536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8b34d4c4-6d17-4ada-865c-0a93c672f97f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:56.163908 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8b34d4c4-6d17-4ada-865c-0a93c672f97f tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1266 microversion: 2.1 time: 0.159544 Jun 17 07:44:56.165371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 485/986] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:56 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:56.877795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:56.879579 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:56.888625 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:56.889497 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:56.890519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:56.891172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:57.077242 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:57.097451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:57.100135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:57.101761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9a26b32c-7eb0-43b6-8e7e-7434b289e1ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.228492 Jun 17 07:44:57.102657 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 502/987] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:56 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:57.186416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8d65c167-db46-4b42-baee-cacf4f81db6b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:57.187059 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8d65c167-db46-4b42-baee-cacf4f81db6b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:57.199627 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d65c167-db46-4b42-baee-cacf4f81db6b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:57.200132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d65c167-db46-4b42-baee-cacf4f81db6b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:57.202167 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d65c167-db46-4b42-baee-cacf4f81db6b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:57.204547 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8d65c167-db46-4b42-baee-cacf4f81db6b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:57.497099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8d65c167-db46-4b42-baee-cacf4f81db6b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:57.506094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8d65c167-db46-4b42-baee-cacf4f81db6b tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1452 microversion: 2.1 time: 0.328186 Jun 17 07:44:57.506936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 486/988] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:57 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1452 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:57.523983 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9937990f-d696-462a-ac87-74248e648547 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:57.525016 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9937990f-d696-462a-ac87-74248e648547 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:57.535459 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9937990f-d696-462a-ac87-74248e648547 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:57.536106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9937990f-d696-462a-ac87-74248e648547 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:57.537389 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9937990f-d696-462a-ac87-74248e648547 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:57.538001 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9937990f-d696-462a-ac87-74248e648547 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:57.727008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9937990f-d696-462a-ac87-74248e648547 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:57.737510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9937990f-d696-462a-ac87-74248e648547 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1452 microversion: 2.1 time: 0.217665 Jun 17 07:44:57.738348 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 503/989] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:44:57 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1452 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:44:58.125171 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:58.126431 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:58.135421 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:58.136973 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:58.138071 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:58.138665 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:58.504726 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:58.515130 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:58.523397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:58.525249 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-795b6625-1561-4281-ac4f-fc064384504e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1743 microversion: 2.20 time: 0.407727 Jun 17 07:44:58.526228 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 487/990] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:58 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1743 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:44:59.546813 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:44:59.547408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:44:59.555490 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:59.556212 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:59.569520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:44:59.569520 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:44:59.771842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:59.780255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:59.781816 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:44:59.783176 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-678d3417-3065-4157-8890-32ec3a521868 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1743 microversion: 2.20 time: 0.242057 Jun 17 07:44:59.783744 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 504/991] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:44:59 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:00.801146 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:00.802628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:00.810884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:00.811471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:00.812526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:00.813178 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:01.018630 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:01.034719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:01.034719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:01.040826 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3b6059c7-3b4c-4a24-9b61-6176271f683a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1743 microversion: 2.20 time: 0.240946 Jun 17 07:45:01.041863 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 488/992] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:00 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1743 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:01.063684 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-446eea6d-774f-408d-ae2c-b60a9f851b47 req-d24b3640-f2ea-4ff9-8176-340b2754573d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6def01-9ebf-4b6c-a559-59f912178f66", "tag": "4c771250-5a6d-4b03-9b41-002f7edfd23a"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:45:01.075648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-446eea6d-774f-408d-ae2c-b60a9f851b47 req-d24b3640-f2ea-4ff9-8176-340b2754573d service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:01.076461 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-446eea6d-774f-408d-ae2c-b60a9f851b47 req-d24b3640-f2ea-4ff9-8176-340b2754573d service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:01.091159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-446eea6d-774f-408d-ae2c-b60a9f851b47 req-d24b3640-f2ea-4ff9-8176-340b2754573d service nova] Creating event network-changed:4c771250-5a6d-4b03-9b41-002f7edfd23a for instance fd6def01-9ebf-4b6c-a559-59f912178f66 on hv-cinder-79733 Jun 17 07:45:01.096242 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-446eea6d-774f-408d-ae2c-b60a9f851b47 req-d24b3640-f2ea-4ff9-8176-340b2754573d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036155 Jun 17 07:45:01.097356 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 505/993] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:45:01.532024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-95c4dd2b-4dc6-4490-b428-1900c6b7d0b0 req-bc2fa7ed-4b0e-4e78-a524-0ff357eb2186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871cb913-ba89-4924-8a2c-ad61a797c36b", "name": "network-vif-plugged", "status": "completed", "tag": "801e37b2-c880-4c3a-a5bd-cdf86430b915"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:45:01.544972 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-95c4dd2b-4dc6-4490-b428-1900c6b7d0b0 req-bc2fa7ed-4b0e-4e78-a524-0ff357eb2186 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:01.545703 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-95c4dd2b-4dc6-4490-b428-1900c6b7d0b0 req-bc2fa7ed-4b0e-4e78-a524-0ff357eb2186 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:01.557611 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-95c4dd2b-4dc6-4490-b428-1900c6b7d0b0 req-bc2fa7ed-4b0e-4e78-a524-0ff357eb2186 service nova] Creating event network-vif-plugged:801e37b2-c880-4c3a-a5bd-cdf86430b915 for instance 871cb913-ba89-4924-8a2c-ad61a797c36b on hv-cinder-79733 Jun 17 07:45:01.564112 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-95c4dd2b-4dc6-4490-b428-1900c6b7d0b0 req-bc2fa7ed-4b0e-4e78-a524-0ff357eb2186 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036137 Jun 17 07:45:01.565467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 489/994] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:45:02.061778 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:02.062513 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:02.078338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:02.079024 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:02.079752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:02.080439 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:02.266615 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:02.283587 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:02.286985 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:02.289910 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-974ee4aa-658b-408b-b197-ba8c20ab8f1c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1743 microversion: 2.20 time: 0.232701 Jun 17 07:45:02.302899 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 506/995] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:02 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1743 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:03.318775 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:03.319460 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:03.325840 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:03.326283 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:03.327028 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:03.327458 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:03.463719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:03.475742 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:03.489555 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:03.489555 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f7d2bb3f-2eba-4ae8-a793-9e0814bde842 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1743 microversion: 2.20 time: 0.164999 Jun 17 07:45:03.489555 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 490/996] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:03 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:45:04.502431 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:04.502949 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:04.510243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:04.511549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:04.512508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:04.513129 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:04.697742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:04.709198 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:04.710905 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:04.712203 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-86246a3f-753a-46b2-a57d-4ec27b3f8ecd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1743 microversion: 2.20 time: 0.214096 Jun 17 07:45:04.712921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 507/997] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:04 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:05.732862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:05.734054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:05.741176 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:05.744440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:05.744440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:05.744440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:05.777684 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=100 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:05.934582 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:05.945452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:05.947789 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:05.950396 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-414a83ea-288c-4ff1-ab9e-838527d51718 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.222012 Jun 17 07:45:05.951419 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 491/998] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:05 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:06.971318 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:06.972716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:06.985220 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:06.985707 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:06.986488 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:06.991393 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:07.004151 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=100 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:07.167612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:07.200556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:07.202414 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:07.203660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-af15cbea-50f4-4dbe-9fa7-cc3d726006c5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.236418 Jun 17 07:45:07.204232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 508/999] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:06 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:08.223762 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:08.227732 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:08.234132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:08.234930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:08.236006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:08.236694 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:08.390757 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:08.400036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:08.402254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:08.403763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-064997d2-e2d3-4a4a-930d-5f9e8bc2e338 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.184154 Jun 17 07:45:08.414358 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 492/1000] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:08 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:09.422675 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:09.423288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:09.429710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:09.430150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:09.430900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:09.431328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:09.576293 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:09.584126 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:09.585713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:09.586857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-52d99855-6b25-4a8c-9cc2-c3140473f6fd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.168459 Jun 17 07:45:09.587417 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 509/1001] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:09 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:10.606586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:10.611661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:10.614146 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:10.614593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:10.615356 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:10.615850 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:10.769992 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:10.780172 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:10.781958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:10.783228 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9f689840-52b4-4579-8910-40e6ff28a492 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.181823 Jun 17 07:45:10.784072 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 493/1002] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:10 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:11.803075 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:11.803679 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:11.811474 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:11.811985 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:11.813018 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:11.813559 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:11.956060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:11.964459 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:11.966274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:11.967726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-daa39d79-df33-4930-a81b-34e7dd18136a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.168813 Jun 17 07:45:11.968274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 510/1003] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:11 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:12.986777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:12.988359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:12.996857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:12.997631 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:12.998414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:12.998917 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:13.200246 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:13.211364 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:13.217298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:13.217298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-816bd3c9-b24c-4b22-ae7a-b8f28f2cf33e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.232757 Jun 17 07:45:13.217298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 494/1004] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:12 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:14.239019 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:14.239629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:14.241487 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=52 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:14.246487 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:14.246911 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:14.247660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:14.248086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:14.395599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:14.404227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:14.405878 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:14.407051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3a7132d9-549f-40fb-b73f-71bdfcdcb4ca tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.172206 Jun 17 07:45:14.407645 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 511/1005] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:14 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:15.439399 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:15.442396 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:15.460454 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:15.460917 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:15.461750 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:15.462190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:15.641402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:15.651739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:15.653811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:15.655200 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b30b45a1-8466-452a-bdca-1f66f6f64566 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.223332 Jun 17 07:45:15.656075 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 495/1006] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:15 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:16.675544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:16.676149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:16.684063 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:16.684505 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:16.685410 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:16.686070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:16.833078 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:16.843234 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:16.845020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:16.846229 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3ed46e88-679a-4bbc-a9c9-abe7c5f5d92f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.175725 Jun 17 07:45:16.847139 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 512/1007] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:16 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:17.867547 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:17.868183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:17.874949 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:17.875396 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:17.876191 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:17.876628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:18.009133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:18.018253 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:18.019769 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:18.020930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-092718ba-26aa-424e-bb27-7a7a755f882a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.157690 Jun 17 07:45:18.024355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 496/1008] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:17 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:19.043496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:19.044205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:19.050627 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:19.051063 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:19.051844 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:19.052271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:19.185594 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:19.193530 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:19.195013 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:19.196162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d52e256c-0641-43e4-b546-cce190e29e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.157222 Jun 17 07:45:19.196714 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 513/1009] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:19 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:20.214298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:20.214939 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:20.222866 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:20.223337 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:20.224267 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:20.224767 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:20.357978 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:20.365989 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:20.367532 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:20.368695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-13d2e913-60d1-4dee-8884-84da076a688e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1738 microversion: 2.20 time: 0.158396 Jun 17 07:45:20.369260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 497/1010] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:20 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:21.388639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:21.389943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:21.396966 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:21.397631 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:21.398387 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:21.398993 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:21.535626 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:21.543814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:21.545345 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:21.546492 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e37f9376-bba9-4ad6-9258-2b37108ed3ee tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1720 microversion: 2.20 time: 0.162661 Jun 17 07:45:21.547045 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 514/1011] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:21 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:22.564317 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:22.564958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:22.567310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=32 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:22.572073 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:22.572512 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:22.573263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:22.573908 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:22.720599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:22.728593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:22.730507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:22.731825 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5e5571a0-f5b4-45bb-8255-573a5bea9011 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1720 microversion: 2.20 time: 0.171254 Jun 17 07:45:22.732387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 498/1012] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:22 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:23.750515 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:23.751257 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:23.757719 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:23.758163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:23.758925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:23.759383 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:23.896967 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:23.904911 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:23.906503 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:23.907648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a3f532e7-86ba-4ab4-902e-5392023f5a9f tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1723 microversion: 2.20 time: 0.161639 Jun 17 07:45:23.908205 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 515/1013] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:23 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:23.925493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e86c1276-0e53-451c-900b-b81dc38993fa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7491f71b-6f66-4e38-b67d-1effde0f6cd4"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:45:23.926550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e86c1276-0e53-451c-900b-b81dc38993fa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:23.933035 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e86c1276-0e53-451c-900b-b81dc38993fa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:23.933535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e86c1276-0e53-451c-900b-b81dc38993fa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:23.935000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e86c1276-0e53-451c-900b-b81dc38993fa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:23.935745 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e86c1276-0e53-451c-900b-b81dc38993fa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:25.166610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e86c1276-0e53-451c-900b-b81dc38993fa tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.245052 Jun 17 07:45:25.174015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 499/1014] 10.222.0.52 () {62 vars in 1363 bytes} [Fri Jun 17 07:45:23 2022] POST /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/os-volume_attachments => generated 188 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:45:25.307296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-1663871a-2f83-4d9a-9de5-c622f06b7d11 req-d4e8f7e0-06ef-4aee-b555-4483924ba727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871cb913-ba89-4924-8a2c-ad61a797c36b", "name": "network-vif-unplugged", "status": "completed", "tag": "801e37b2-c880-4c3a-a5bd-cdf86430b915"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:45:25.316330 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-05ce8b48-64fa-470b-be62-5b0b32fc6fa5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:25.316820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-05ce8b48-64fa-470b-be62-5b0b32fc6fa5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:25.317727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-1663871a-2f83-4d9a-9de5-c622f06b7d11 req-d4e8f7e0-06ef-4aee-b555-4483924ba727 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:25.318194 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-1663871a-2f83-4d9a-9de5-c622f06b7d11 req-d4e8f7e0-06ef-4aee-b555-4483924ba727 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:25.323075 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-05ce8b48-64fa-470b-be62-5b0b32fc6fa5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:25.323536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-05ce8b48-64fa-470b-be62-5b0b32fc6fa5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:25.324387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-05ce8b48-64fa-470b-be62-5b0b32fc6fa5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:25.325004 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-05ce8b48-64fa-470b-be62-5b0b32fc6fa5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:25.331030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.compute.server_external_events [req-1663871a-2f83-4d9a-9de5-c622f06b7d11 req-d4e8f7e0-06ef-4aee-b555-4483924ba727 service nova] Unable to find a host for instance 871cb913-ba89-4924-8a2c-ad61a797c36b. Dropping event network-vif-unplugged {{(pid=124472) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 07:45:25.331929 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-1663871a-2f83-4d9a-9de5-c622f06b7d11 req-d4e8f7e0-06ef-4aee-b555-4483924ba727 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034647 Jun 17 07:45:25.332542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 516/1015] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 17 07:45:26.063734 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-05ce8b48-64fa-470b-be62-5b0b32fc6fa5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "DELETE /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/os-volume_attachments/7491f71b-6f66-4e38-b67d-1effde0f6cd4" status: 202 len: 0 microversion: 2.20 time: 0.751327 Jun 17 07:45:26.064357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 500/1016] 10.222.0.52 () {60 vars in 1456 bytes} [Fri Jun 17 07:45:25 2022] DELETE /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/os-volume_attachments/7491f71b-6f66-4e38-b67d-1effde0f6cd4 => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:45:26.124680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-48d0df13-faf8-4114-af8e-fb285e6b5024 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:45:26.125179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-48d0df13-faf8-4114-af8e-fb285e6b5024 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:26.131350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-48d0df13-faf8-4114-af8e-fb285e6b5024 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:26.131796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-48d0df13-faf8-4114-af8e-fb285e6b5024 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:26.132603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-48d0df13-faf8-4114-af8e-fb285e6b5024 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:26.133005 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-48d0df13-faf8-4114-af8e-fb285e6b5024 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:26.397816 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-48d0df13-faf8-4114-af8e-fb285e6b5024 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "POST /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/action" status: 202 len: 0 microversion: 2.20 time: 0.277149 Jun 17 07:45:26.399247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 517/1017] 10.222.0.52 () {62 vars in 1318 bytes} [Fri Jun 17 07:45:26 2022] POST /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:45:26.407348 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:26.407958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:26.414549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:26.414993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:26.415770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:26.416206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:26.576957 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:26.585848 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:26.587359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:26.588526 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e5bcc863-4637-42b7-9348-14476e1dd60a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1671 microversion: 2.20 time: 0.185189 Jun 17 07:45:26.589083 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 501/1018] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:26 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:27.617937 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:27.618672 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:27.626429 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:27.626879 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:27.627656 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:27.628094 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:27.772025 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:27.781082 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:27.782801 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:27.788593 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9e13a961-778e-4203-b248-68551069d9c7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1671 microversion: 2.20 time: 0.179926 Jun 17 07:45:27.788593 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 518/1019] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:27 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:28.803456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:28.804125 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:28.811145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:28.811599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:28.812490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:28.812987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:29.030486 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:29.038466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:29.040057 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:29.041227 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1a2faa3b-020a-4be0-9977-8aa2d87ff85b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.241729 Jun 17 07:45:29.041824 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 502/1020] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:28 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:30.060248 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:30.061572 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:30.081532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:30.081861 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:30.082599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:30.083060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:30.261834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:30.270033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:30.271586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:30.272775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f3a71237-681b-4220-b0fb-e5cea0e64a80 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.216487 Jun 17 07:45:30.273364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 519/1021] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:30 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:31.293700 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:31.294383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:31.302002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:31.302447 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:31.303209 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:31.303642 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:31.306170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:31.450420 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:31.459862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:31.463493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:31.463493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-18587bcd-6a68-42f8-b8e4-8f78216976b3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.172807 Jun 17 07:45:31.463493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 503/1022] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:31 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:32.482005 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:32.482720 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:32.489286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:32.489763 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:32.490544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:32.490984 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:32.644290 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:32.652258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:32.653960 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:32.655225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4912a1f5-ce27-4843-97a3-d393c67d9a96 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.177688 Jun 17 07:45:32.655788 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 520/1023] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:32 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:33.677183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:33.677859 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:33.685664 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:33.686432 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:33.687278 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:33.687717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:33.837654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:33.847403 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:33.848910 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:33.850188 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-78bd543d-d063-461b-9fe3-6a3fd08d2087 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.178920 Jun 17 07:45:33.850736 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 504/1024] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:33 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:34.868638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:34.869246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:34.875826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:34.876267 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:34.877032 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:34.877507 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:35.019225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:35.027117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:35.028615 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:35.030367 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d8b815b4-ca9e-4d9a-906d-3b20e36940cb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.165751 Jun 17 07:45:35.030919 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 521/1025] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:34 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:36.049004 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:36.049633 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:36.055678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:36.056123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:36.056881 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:36.057310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:36.193698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:36.201876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:36.203428 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:36.204575 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dfed96eb-7164-444c-90e4-c0a53d2ae4f7 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.160191 Jun 17 07:45:36.205134 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 505/1026] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:36 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:37.228177 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:37.230805 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:37.239433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:37.239884 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:37.240668 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:37.241109 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:37.244155 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:37.379360 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:37.388225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:37.393397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:37.393397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ba24819d-d019-434f-a1ea-9b7d74c71dce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.171863 Jun 17 07:45:37.393397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 522/1027] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:37 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:38.410133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:38.410724 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:38.417547 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:38.418101 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:38.418939 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:38.419600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:38.558622 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:38.567163 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:38.568728 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:38.569940 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-daf662c2-e3ee-498b-ae24-fe4b6396fa70 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.163837 Jun 17 07:45:38.570500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 506/1028] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:38 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:39.589052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:39.589686 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:39.596767 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:39.600817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:39.600817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:39.600817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:39.758913 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:39.767593 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:39.769091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:39.770303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cb41cec1-61b0-45e6-b679-7a1dcd78c2e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.185600 Jun 17 07:45:39.770874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 523/1029] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:39 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:40.789230 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:40.789902 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:40.797381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:40.797831 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:40.798605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:40.799210 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:40.950946 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:40.960054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:40.961609 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:40.962776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-54f17d80-ef38-452f-babf-bbc43735e450 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.177506 Jun 17 07:45:40.963380 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 507/1030] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:40 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:41.986298 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:41.987033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:41.996312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:41.996312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:41.996312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:41.996312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:42.129817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:42.137815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:42.143943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:42.143943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-380d01de-f660-4c96-8e3c-5bd8baaa2efe tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.162139 Jun 17 07:45:42.143943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 524/1031] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:41 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:43.159025 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:43.159669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:43.166378 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:43.166830 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:43.167610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:43.168048 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:43.312573 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:43.321302 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:43.322857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:43.324074 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-34b0869b-6737-4e6d-90f4-bfc50f38215b tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.168957 Jun 17 07:45:43.335729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 508/1032] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:43 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:44.345939 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:44.346556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:44.352785 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:44.353222 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:44.354275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:44.354775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:44.496072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:44.505004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:44.506536 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:44.507707 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c5e1315d-7403-4ede-854b-c47ff4b97d56 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.166351 Jun 17 07:45:44.508257 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 525/1033] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:44 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:45.530766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:45.531379 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:45.538102 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:45.538549 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:45.539310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:45.539740 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:45.676395 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:45.684572 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:45.686753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:45.687920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c428c453-ea2f-427e-94da-84de226934ce tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.161806 Jun 17 07:45:45.688471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 509/1034] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:45 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:46.706087 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:46.706746 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:46.709098 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=32 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:46.714080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:46.714781 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:46.715713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:46.716146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:46.846484 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:46.854804 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:46.856305 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:46.858396 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0e9b6dfb-7e3e-4f79-aa6a-a6ae017d00dc tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.156026 Jun 17 07:45:46.859048 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 526/1035] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:46 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:47.876919 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:47.877475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:47.883908 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:47.884349 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:47.885103 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:47.885561 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:48.016721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:48.024642 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:48.026190 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:48.027464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7709fe2f-8a4d-4d21-9885-e7653efce82a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.154561 Jun 17 07:45:48.028019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 510/1036] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:47 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:49.047295 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:49.047858 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:49.054483 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:49.054926 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:49.055698 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:49.056125 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:49.192565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:49.201405 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:49.202915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:49.204074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f7bd255f-9549-4c8a-9bac-e07b66c060bd tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.161842 Jun 17 07:45:49.204636 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 527/1037] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:49 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:50.222248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:50.222845 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:50.229654 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:50.230106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:50.230871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:50.231306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:50.380038 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:50.388539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:50.390065 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:50.391221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-81d5e80d-6545-4614-9822-f8e881f070e1 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.172934 Jun 17 07:45:50.391780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 511/1038] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:50 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:51.409145 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:51.409768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:51.416243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:51.416680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:51.417468 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:51.417896 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:51.553096 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:51.562602 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:51.564106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:51.565287 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c2bf3a2e-921d-4bc5-8849-eb11b9584426 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.160091 Jun 17 07:45:51.565876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 528/1039] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:51 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:52.584392 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:52.584977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:52.592415 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:52.592864 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:52.593670 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:52.594104 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:52.730217 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:52.739125 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:52.740715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:52.741953 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-117c834b-5666-4a44-ba70-9e8cc32cc409 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.161476 Jun 17 07:45:52.742520 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 512/1040] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:52 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:53.760249 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:53.760880 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:53.767887 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:53.768321 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:53.769070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:53.769536 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:53.900870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:53.909478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:53.911232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:53.912387 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-684cf600-c743-42da-a702-3ea5855b78d2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.156160 Jun 17 07:45:53.912944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 529/1041] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:53 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:54.931659 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:54.933088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:54.936593 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=30 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:45:54.941392 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:54.945888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:54.945888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:54.945888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:55.076442 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:55.085115 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:55.086799 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:55.088164 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ea60c449-e47d-4283-96fe-40b13fa24ee5 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.161399 Jun 17 07:45:55.088766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 513/1042] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:54 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:56.107468 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:56.108065 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:56.114789 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:56.115231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:56.115985 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:56.116414 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:56.256649 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:56.265641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:56.267173 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:56.268380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fdbcdb00-f7ca-450e-b8a2-931580bf5e09 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.165407 Jun 17 07:45:56.268965 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 530/1043] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:56 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:57.288202 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:57.289288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:57.297006 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:57.302351 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:57.302351 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:57.302351 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:57.363963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-c3d977c8-1221-4994-863c-4e874bf422b6 req-c759b190-383c-400a-b4c6-45d5863bca20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871cb913-ba89-4924-8a2c-ad61a797c36b", "name": "network-vif-plugged", "status": "completed", "tag": "801e37b2-c880-4c3a-a5bd-cdf86430b915"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:45:57.373493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-c3d977c8-1221-4994-863c-4e874bf422b6 req-c759b190-383c-400a-b4c6-45d5863bca20 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:57.373941 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-c3d977c8-1221-4994-863c-4e874bf422b6 req-c759b190-383c-400a-b4c6-45d5863bca20 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:57.385968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-c3d977c8-1221-4994-863c-4e874bf422b6 req-c759b190-383c-400a-b4c6-45d5863bca20 service nova] Creating event network-vif-plugged:801e37b2-c880-4c3a-a5bd-cdf86430b915 for instance 871cb913-ba89-4924-8a2c-ad61a797c36b on hv-cinder-79733 Jun 17 07:45:57.392420 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-c3d977c8-1221-4994-863c-4e874bf422b6 req-c759b190-383c-400a-b4c6-45d5863bca20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166797 Jun 17 07:45:57.393241 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 514/1044] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:45:57.454331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:57.462644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:57.464138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:57.465938 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fcf47af1-ac57-48bb-a4f9-436303d38f49 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.182671 Jun 17 07:45:57.466701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 531/1045] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:57 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:58.485240 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:58.485968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:58.492212 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:58.492598 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:58.493368 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:58.493803 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:58.624841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:58.632821 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:58.634383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:58.635541 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e835c4a5-1d86-41ad-a97f-bda4bfb1389d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.155194 Jun 17 07:45:58.636108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 515/1046] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:58 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:45:59.655556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:45:59.656160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:45:59.663098 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:59.663545 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:59.664310 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:45:59.664745 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:45:59.814794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:59.822805 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:59.824930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:45:59.826132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a3d6ff4a-a8f8-4e88-aad4-605c38cc747c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.175090 Jun 17 07:45:59.826688 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 532/1047] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:45:59 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:46:00.844172 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:00.844797 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:00.852037 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:00.852485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:00.853267 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:00.853733 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:00.998557 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:01.006565 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:01.008057 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:01.009243 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-04da1ba1-2368-4b38-86a3-900243fc9989 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.169186 Jun 17 07:46:01.009825 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 516/1048] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:46:00 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:46:02.028621 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:02.029217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:02.035874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:02.036317 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:02.037080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:02.037542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:02.170641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:02.178809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:02.180319 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:02.181521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-df12bde3-f86a-4e43-b178-6b4524de811e tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.157868 Jun 17 07:46:02.182091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 533/1049] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:46:02 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:46:03.201331 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:03.201952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:03.208449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:03.208896 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:03.209695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:03.210141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:03.345552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:03.353814 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:03.355366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:03.356539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-24b82ace-454c-4e19-9db6-6dd1f127c0ae tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1729 microversion: 2.20 time: 0.160039 Jun 17 07:46:03.357106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 517/1050] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:46:03 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:46:04.375254 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:04.375939 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:04.382350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:04.382794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:04.383552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:04.383989 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:04.520834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:04.529582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:04.531088 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:04.532253 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d247c3c1-5e3d-4dc7-9f4d-e548e6abaf78 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1716 microversion: 2.20 time: 0.161563 Jun 17 07:46:04.532814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 534/1051] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:46:04 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:46:06.945434 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0a2410d0-22e5-4758-be2d-22b680094bc8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:06.946015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0a2410d0-22e5-4758-be2d-22b680094bc8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:06.952326 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0a2410d0-22e5-4758-be2d-22b680094bc8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:06.952778 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0a2410d0-22e5-4758-be2d-22b680094bc8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:06.953700 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0a2410d0-22e5-4758-be2d-22b680094bc8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:06.954140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0a2410d0-22e5-4758-be2d-22b680094bc8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:06.956620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=86 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:06.978895 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0a2410d0-22e5-4758-be2d-22b680094bc8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/ips" status: 200 len: 146 microversion: 2.1 time: 0.037549 Jun 17 07:46:06.980040 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 518/1052] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:46:06 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:09.634272 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-24351dcf-0645-486d-8933-e3f27a0a7168 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "500cd02c-201a-490f-8707-509023fd7d46"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:46:09.636016 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-24351dcf-0645-486d-8933-e3f27a0a7168 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:09.642636 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24351dcf-0645-486d-8933-e3f27a0a7168 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:09.643073 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24351dcf-0645-486d-8933-e3f27a0a7168 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:09.644091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24351dcf-0645-486d-8933-e3f27a0a7168 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:09.644254 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-24351dcf-0645-486d-8933-e3f27a0a7168 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:09.647891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=78 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:10.481445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-24351dcf-0645-486d-8933-e3f27a0a7168 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.850866 Jun 17 07:46:10.482055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 535/1053] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:46:09 2022] POST /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:24.437836 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6a186408-a2c9-48c9-be5b-f48040835c8e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:24.439468 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6a186408-a2c9-48c9-be5b-f48040835c8e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:24.447627 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=11 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:24.449693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6a186408-a2c9-48c9-be5b-f48040835c8e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:24.450400 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6a186408-a2c9-48c9-be5b-f48040835c8e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:24.451412 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6a186408-a2c9-48c9-be5b-f48040835c8e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:24.452082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6a186408-a2c9-48c9-be5b-f48040835c8e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:24.483794 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6a186408-a2c9-48c9-be5b-f48040835c8e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049694 Jun 17 07:46:24.489550 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 519/1054] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:46:24 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:24.498021 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-72dc4893-db26-4b87-989c-03b581042bc9 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:24.499654 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-72dc4893-db26-4b87-989c-03b581042bc9 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:24.506723 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=19 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:24.507700 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:24.516230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-72dc4893-db26-4b87-989c-03b581042bc9 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:24.516770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-72dc4893-db26-4b87-989c-03b581042bc9 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:24.517607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-72dc4893-db26-4b87-989c-03b581042bc9 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:24.518069 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-72dc4893-db26-4b87-989c-03b581042bc9 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:24.554670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-72dc4893-db26-4b87-989c-03b581042bc9 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/500cd02c-201a-490f-8707-509023fd7d46" status: 200 len: 194 microversion: 2.1 time: 0.063336 Jun 17 07:46:24.555320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 536/1055] 10.222.0.52 () {58 vars in 1412 bytes} [Fri Jun 17 07:46:24 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/500cd02c-201a-490f-8707-509023fd7d46 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:27.279051 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-77dd0dd2-aafb-4eae-bf05-d187e29835e2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "355058f3-58c8-451e-b884-5f626860d934"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:46:27.280782 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-77dd0dd2-aafb-4eae-bf05-d187e29835e2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:27.288435 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77dd0dd2-aafb-4eae-bf05-d187e29835e2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:27.288955 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77dd0dd2-aafb-4eae-bf05-d187e29835e2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:27.290757 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77dd0dd2-aafb-4eae-bf05-d187e29835e2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:27.291449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77dd0dd2-aafb-4eae-bf05-d187e29835e2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:28.183477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-77dd0dd2-aafb-4eae-bf05-d187e29835e2 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "POST /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.910403 Jun 17 07:46:28.184247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 520/1056] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:46:27 2022] POST /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments => generated 194 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:30.847232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:46:30.847915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 07:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:46:36.613610 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e141bc49-2ca9-441e-af88-a330b9c9e2af tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Action: 'create', calling method: .version_select at 0x7fb06a695040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1002023244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCglQbqOWmMRCUkO7W2PDMLPBRKHfhfIYdafQobp4JgwgzIaHOKoS1JzpdfarolDYFFMALF/SDtLZM/w5+rtCh2tmUnX+hhUyqzHbMW/WZAgzDkjdUpyQX+03PS3P0nEDQ=="}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:46:36.628623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-e141bc49-2ca9-441e-af88-a330b9c9e2af tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Getting quotas for project 7b7f8de890ca4b1a82898a24488b32dd. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:46:36.632350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-e141bc49-2ca9-441e-af88-a330b9c9e2af tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Getting quotas for user c4a915f6c02d4facb64d5332904f9fe6 and project 7b7f8de890ca4b1a82898a24488b32dd. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:46:36.744375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e141bc49-2ca9-441e-af88-a330b9c9e2af tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.135176 Jun 17 07:46:36.744982 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 537/1057] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:46:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:36.799826 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1115664883", "imageRef": "626c3981-c74c-4c53-852f-519840da87ee", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1002023244", "networks": [{"uuid": "491deffc-9fd2-493e-b525-2aca193b3ae7"}]}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:46:36.851721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] validate_networks() for [('491deffc-9fd2-493e-b525-2aca193b3ae7', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:46:37.241968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:46:37.242387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:46:37.242930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:46:37.243332 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:46:37.243737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:46:37.252676 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:37.253111 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:37.253929 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:37.254360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:37.271071 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Getting quotas for project 7b7f8de890ca4b1a82898a24488b32dd. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:46:37.275915 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Getting quotas for user c4a915f6c02d4facb64d5332904f9fe6 and project 7b7f8de890ca4b1a82898a24488b32dd. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:46:37.286829 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:46:37.289105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='626c3981-c74c-4c53-852f-519840da87ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:46:37.489128 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5d6dc2d7-d579-49a1-9cd4-1c070f7553ed tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693919 Jun 17 07:46:37.489744 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 521/1058] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:46:37.500171 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-07e305ec-c5e9-457b-ab8c-54c2fb1770a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:37.500866 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-07e305ec-c5e9-457b-ab8c-54c2fb1770a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:37.561072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-07e305ec-c5e9-457b-ab8c-54c2fb1770a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:37.567664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-07e305ec-c5e9-457b-ab8c-54c2fb1770a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1259 microversion: 2.1 time: 0.071766 Jun 17 07:46:37.568229 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 538/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:37 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:37.927369 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-34118401-98bc-465b-a33e-c2da8dd63bf7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:37.928350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-34118401-98bc-465b-a33e-c2da8dd63bf7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:37.935144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34118401-98bc-465b-a33e-c2da8dd63bf7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:37.935590 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34118401-98bc-465b-a33e-c2da8dd63bf7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:37.936357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34118401-98bc-465b-a33e-c2da8dd63bf7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:37.936791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34118401-98bc-465b-a33e-c2da8dd63bf7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:37.969520 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-34118401-98bc-465b-a33e-c2da8dd63bf7 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046027 Jun 17 07:46:37.970079 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 522/1060] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:46:37 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:38.112570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2854305c-e32c-4e8c-9bb7-799f168a8cde tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:38.113183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2854305c-e32c-4e8c-9bb7-799f168a8cde tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:38.120532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2854305c-e32c-4e8c-9bb7-799f168a8cde tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:38.120972 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2854305c-e32c-4e8c-9bb7-799f168a8cde tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:38.121757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2854305c-e32c-4e8c-9bb7-799f168a8cde tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:38.122185 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2854305c-e32c-4e8c-9bb7-799f168a8cde tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:38.154011 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2854305c-e32c-4e8c-9bb7-799f168a8cde tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/500cd02c-201a-490f-8707-509023fd7d46" status: 200 len: 194 microversion: 2.1 time: 0.046743 Jun 17 07:46:38.154619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 539/1061] 10.222.0.52 () {58 vars in 1412 bytes} [Fri Jun 17 07:46:38 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/500cd02c-201a-490f-8707-509023fd7d46 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:38.164133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4289d8b3-f6df-42af-a62c-d5845f773944 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:38.165247 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4289d8b3-f6df-42af-a62c-d5845f773944 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:38.171600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4289d8b3-f6df-42af-a62c-d5845f773944 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:38.172070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4289d8b3-f6df-42af-a62c-d5845f773944 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:38.172807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4289d8b3-f6df-42af-a62c-d5845f773944 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:38.173240 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4289d8b3-f6df-42af-a62c-d5845f773944 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:38.254657 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-4289d8b3-f6df-42af-a62c-d5845f773944 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lazy-loading 'services' on Instance uuid c0d09958-4d1a-44e5-8f46-26f8d80d16b9 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:46:38.541116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4289d8b3-f6df-42af-a62c-d5845f773944 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/500cd02c-201a-490f-8707-509023fd7d46" status: 202 len: 0 microversion: 2.1 time: 0.379650 Jun 17 07:46:38.543057 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 523/1062] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:46:38 2022] DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/500cd02c-201a-490f-8707-509023fd7d46 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:46:38.584314 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a9b49ddb-f986-43e3-9945-bc455e59a270 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:38.585530 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a9b49ddb-f986-43e3-9945-bc455e59a270 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:38.644059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a9b49ddb-f986-43e3-9945-bc455e59a270 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:38.652255 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a9b49ddb-f986-43e3-9945-bc455e59a270 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1259 microversion: 2.1 time: 0.071715 Jun 17 07:46:38.652833 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 540/1063] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:38 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:39.670254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d6e963f1-5f65-4539-9b4c-9d68a234e7df tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:39.674709 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d6e963f1-5f65-4539-9b4c-9d68a234e7df tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:39.677597 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d6e963f1-5f65-4539-9b4c-9d68a234e7df tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:39.678046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d6e963f1-5f65-4539-9b4c-9d68a234e7df tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:39.678870 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d6e963f1-5f65-4539-9b4c-9d68a234e7df tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:39.679361 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d6e963f1-5f65-4539-9b4c-9d68a234e7df tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:39.743695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d6e963f1-5f65-4539-9b4c-9d68a234e7df tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:39.751703 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d6e963f1-5f65-4539-9b4c-9d68a234e7df tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1255 microversion: 2.1 time: 0.086909 Jun 17 07:46:39.752280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 524/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:39 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1255 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:40.716202 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-70afc89b-399f-49de-8eb8-3b8ccb0261a6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:40.716816 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-70afc89b-399f-49de-8eb8-3b8ccb0261a6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:40.724357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-70afc89b-399f-49de-8eb8-3b8ccb0261a6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:40.724723 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-70afc89b-399f-49de-8eb8-3b8ccb0261a6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:40.725623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-70afc89b-399f-49de-8eb8-3b8ccb0261a6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:40.726073 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-70afc89b-399f-49de-8eb8-3b8ccb0261a6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:40.757121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-70afc89b-399f-49de-8eb8-3b8ccb0261a6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/355058f3-58c8-451e-b884-5f626860d934" status: 200 len: 194 microversion: 2.1 time: 0.045953 Jun 17 07:46:40.757768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 541/1065] 10.222.0.52 () {58 vars in 1412 bytes} [Fri Jun 17 07:46:40 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/355058f3-58c8-451e-b884-5f626860d934 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:40.767799 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a43fe423-20f4-40fe-9459-3bf9cc55276e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:40.769041 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a43fe423-20f4-40fe-9459-3bf9cc55276e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:40.775373 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6af6015d-0963-4aac-b7aa-be8530424b19 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:40.776144 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6af6015d-0963-4aac-b7aa-be8530424b19 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:40.776538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a43fe423-20f4-40fe-9459-3bf9cc55276e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:40.777082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a43fe423-20f4-40fe-9459-3bf9cc55276e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:40.778092 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a43fe423-20f4-40fe-9459-3bf9cc55276e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:40.778861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a43fe423-20f4-40fe-9459-3bf9cc55276e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:40.783405 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6af6015d-0963-4aac-b7aa-be8530424b19 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:40.788364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6af6015d-0963-4aac-b7aa-be8530424b19 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:40.788364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6af6015d-0963-4aac-b7aa-be8530424b19 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:40.788364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6af6015d-0963-4aac-b7aa-be8530424b19 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:40.858644 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6af6015d-0963-4aac-b7aa-be8530424b19 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:40.866526 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6af6015d-0963-4aac-b7aa-be8530424b19 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1317 microversion: 2.1 time: 0.096323 Jun 17 07:46:40.867121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 542/1066] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:40 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:46:40.898927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-a43fe423-20f4-40fe-9459-3bf9cc55276e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lazy-loading 'services' on Instance uuid c0d09958-4d1a-44e5-8f46-26f8d80d16b9 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:46:41.098985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a43fe423-20f4-40fe-9459-3bf9cc55276e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/355058f3-58c8-451e-b884-5f626860d934" status: 202 len: 0 microversion: 2.1 time: 0.335105 Jun 17 07:46:41.099613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 525/1067] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:46:40 2022] DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments/355058f3-58c8-451e-b884-5f626860d934 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:46:41.884517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-46a390fd-9bb0-4229-b357-827ac7d98d8b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:41.885181 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-46a390fd-9bb0-4229-b357-827ac7d98d8b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:41.893464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46a390fd-9bb0-4229-b357-827ac7d98d8b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:41.893913 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46a390fd-9bb0-4229-b357-827ac7d98d8b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:41.894711 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46a390fd-9bb0-4229-b357-827ac7d98d8b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:41.895142 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46a390fd-9bb0-4229-b357-827ac7d98d8b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:42.045893 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-46a390fd-9bb0-4229-b357-827ac7d98d8b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:42.054852 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-46a390fd-9bb0-4229-b357-827ac7d98d8b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.174544 Jun 17 07:46:42.059599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 543/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:41 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:43.074380 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8fb8e32f-2c44-42d3-a6c1-ca7b1e862f0d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:43.075114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8fb8e32f-2c44-42d3-a6c1-ca7b1e862f0d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:43.081409 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8fb8e32f-2c44-42d3-a6c1-ca7b1e862f0d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:43.081864 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8fb8e32f-2c44-42d3-a6c1-ca7b1e862f0d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:43.082634 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8fb8e32f-2c44-42d3-a6c1-ca7b1e862f0d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:43.083074 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8fb8e32f-2c44-42d3-a6c1-ca7b1e862f0d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:43.215652 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8fb8e32f-2c44-42d3-a6c1-ca7b1e862f0d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:43.225626 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8fb8e32f-2c44-42d3-a6c1-ca7b1e862f0d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.156509 Jun 17 07:46:43.234290 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 526/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:43 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:44.242629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c8df1e6d-32e9-4905-bf04-5c8b370fd196 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:44.243745 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c8df1e6d-32e9-4905-bf04-5c8b370fd196 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:44.250563 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c8df1e6d-32e9-4905-bf04-5c8b370fd196 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:44.251020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c8df1e6d-32e9-4905-bf04-5c8b370fd196 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:44.251782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c8df1e6d-32e9-4905-bf04-5c8b370fd196 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:44.252409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c8df1e6d-32e9-4905-bf04-5c8b370fd196 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:44.391426 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c8df1e6d-32e9-4905-bf04-5c8b370fd196 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:44.399756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c8df1e6d-32e9-4905-bf04-5c8b370fd196 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.161468 Jun 17 07:46:44.400341 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 544/1070] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:44 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:45.419377 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-603e00d9-dd69-4ec7-aca7-f88945278062 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:45.420563 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-603e00d9-dd69-4ec7-aca7-f88945278062 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:45.427648 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-603e00d9-dd69-4ec7-aca7-f88945278062 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:45.428096 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-603e00d9-dd69-4ec7-aca7-f88945278062 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:45.428867 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-603e00d9-dd69-4ec7-aca7-f88945278062 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:45.429307 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-603e00d9-dd69-4ec7-aca7-f88945278062 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:45.568082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-603e00d9-dd69-4ec7-aca7-f88945278062 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:45.576795 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-603e00d9-dd69-4ec7-aca7-f88945278062 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.163515 Jun 17 07:46:45.576795 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 527/1071] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:45 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:46.593431 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b3356791-4b69-4485-ab45-af9c44742191 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:46.594014 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b3356791-4b69-4485-ab45-af9c44742191 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:46.600708 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b3356791-4b69-4485-ab45-af9c44742191 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:46.601713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b3356791-4b69-4485-ab45-af9c44742191 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:46.602895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b3356791-4b69-4485-ab45-af9c44742191 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:46.603334 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b3356791-4b69-4485-ab45-af9c44742191 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:46.744469 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b3356791-4b69-4485-ab45-af9c44742191 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:46.752344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b3356791-4b69-4485-ab45-af9c44742191 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.162837 Jun 17 07:46:46.753136 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 545/1072] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:46 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:47.769893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1537c94f-2d5d-40d4-95af-d18b88e2d66d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:47.771163 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1537c94f-2d5d-40d4-95af-d18b88e2d66d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:47.774270 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:47.774940 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=6 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:47.779919 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1537c94f-2d5d-40d4-95af-d18b88e2d66d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:47.780372 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1537c94f-2d5d-40d4-95af-d18b88e2d66d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:47.781150 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1537c94f-2d5d-40d4-95af-d18b88e2d66d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:47.781621 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1537c94f-2d5d-40d4-95af-d18b88e2d66d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:47.924770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1537c94f-2d5d-40d4-95af-d18b88e2d66d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:47.933249 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1537c94f-2d5d-40d4-95af-d18b88e2d66d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.167155 Jun 17 07:46:47.934034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 528/1073] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:47 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:48.950903 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-46c7ab6a-31da-4b59-af19-c9d7df75bb99 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:48.951524 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-46c7ab6a-31da-4b59-af19-c9d7df75bb99 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:48.953949 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=8 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:48.959341 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46c7ab6a-31da-4b59-af19-c9d7df75bb99 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:48.959791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46c7ab6a-31da-4b59-af19-c9d7df75bb99 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:48.960580 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46c7ab6a-31da-4b59-af19-c9d7df75bb99 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:48.961015 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-46c7ab6a-31da-4b59-af19-c9d7df75bb99 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:49.114405 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-46c7ab6a-31da-4b59-af19-c9d7df75bb99 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:49.122088 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-46c7ab6a-31da-4b59-af19-c9d7df75bb99 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.175177 Jun 17 07:46:49.122675 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 546/1074] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:48 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:50.139623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-77212504-8693-4727-9209-4cedc618db93 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:50.140470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-77212504-8693-4727-9209-4cedc618db93 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:50.148468 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77212504-8693-4727-9209-4cedc618db93 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:50.149021 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77212504-8693-4727-9209-4cedc618db93 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:50.149804 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77212504-8693-4727-9209-4cedc618db93 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:50.150239 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-77212504-8693-4727-9209-4cedc618db93 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:50.292493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-77212504-8693-4727-9209-4cedc618db93 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:50.300368 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-77212504-8693-4727-9209-4cedc618db93 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.164609 Jun 17 07:46:50.300958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 529/1075] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:50 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:51.317279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c06e5571-420d-4667-8974-42a4d0e12203 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:51.317917 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c06e5571-420d-4667-8974-42a4d0e12203 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:51.325234 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c06e5571-420d-4667-8974-42a4d0e12203 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:51.325980 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c06e5571-420d-4667-8974-42a4d0e12203 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:51.326934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c06e5571-420d-4667-8974-42a4d0e12203 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:51.327362 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c06e5571-420d-4667-8974-42a4d0e12203 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:51.474397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c06e5571-420d-4667-8974-42a4d0e12203 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:51.482051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c06e5571-420d-4667-8974-42a4d0e12203 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.168661 Jun 17 07:46:51.482617 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 547/1076] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:51 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:52.500083 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f87998f3-7c0f-49eb-9cb8-143713a32b4f tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:52.500780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f87998f3-7c0f-49eb-9cb8-143713a32b4f tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:52.508630 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f87998f3-7c0f-49eb-9cb8-143713a32b4f tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:52.509089 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f87998f3-7c0f-49eb-9cb8-143713a32b4f tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:52.509904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f87998f3-7c0f-49eb-9cb8-143713a32b4f tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:52.510543 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f87998f3-7c0f-49eb-9cb8-143713a32b4f tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:52.654789 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f87998f3-7c0f-49eb-9cb8-143713a32b4f tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:52.663889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f87998f3-7c0f-49eb-9cb8-143713a32b4f tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.167160 Jun 17 07:46:52.664599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 530/1077] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:52 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:53.681399 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4d7cea15-b532-4762-8660-9912bf75f0fd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:53.682076 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4d7cea15-b532-4762-8660-9912bf75f0fd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:53.690702 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d7cea15-b532-4762-8660-9912bf75f0fd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:53.691166 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d7cea15-b532-4762-8660-9912bf75f0fd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:53.692013 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d7cea15-b532-4762-8660-9912bf75f0fd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:53.692447 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4d7cea15-b532-4762-8660-9912bf75f0fd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:53.823970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4d7cea15-b532-4762-8660-9912bf75f0fd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:53.831514 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4d7cea15-b532-4762-8660-9912bf75f0fd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.154273 Jun 17 07:46:53.832092 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 548/1078] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:53 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:54.849200 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-47c13aa5-f1f4-465a-b8ff-6c9d028e822c tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:54.849838 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-47c13aa5-f1f4-465a-b8ff-6c9d028e822c tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:54.856968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-47c13aa5-f1f4-465a-b8ff-6c9d028e822c tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:54.857452 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-47c13aa5-f1f4-465a-b8ff-6c9d028e822c tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:54.858218 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-47c13aa5-f1f4-465a-b8ff-6c9d028e822c tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:54.858656 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-47c13aa5-f1f4-465a-b8ff-6c9d028e822c tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:54.861178 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:54.994079 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-47c13aa5-f1f4-465a-b8ff-6c9d028e822c tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:55.001511 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-47c13aa5-f1f4-465a-b8ff-6c9d028e822c tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.156429 Jun 17 07:46:55.002094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 531/1079] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:54 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:56.018928 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-94ba517f-5e63-4554-b691-c427421ecda9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:56.019539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-94ba517f-5e63-4554-b691-c427421ecda9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:56.026597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-94ba517f-5e63-4554-b691-c427421ecda9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:56.027042 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-94ba517f-5e63-4554-b691-c427421ecda9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:56.027808 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-94ba517f-5e63-4554-b691-c427421ecda9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:56.028244 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-94ba517f-5e63-4554-b691-c427421ecda9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:56.170098 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-94ba517f-5e63-4554-b691-c427421ecda9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:56.177738 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-94ba517f-5e63-4554-b691-c427421ecda9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.162720 Jun 17 07:46:56.178875 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 549/1080] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:56 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:56.759643 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-577b34a3-d10d-4bff-bac2-4fa62cbe503a req-64d5cec2-a88e-4e19-8b02-e7e3282f4231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eef2c2-52d2-40f0-aa8d-6992dbba0198", "tag": "9c6d7ec3-4424-4f87-91d4-940819f13c02"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:46:56.769158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-577b34a3-d10d-4bff-bac2-4fa62cbe503a req-64d5cec2-a88e-4e19-8b02-e7e3282f4231 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:56.769659 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-577b34a3-d10d-4bff-bac2-4fa62cbe503a req-64d5cec2-a88e-4e19-8b02-e7e3282f4231 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:56.788140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-577b34a3-d10d-4bff-bac2-4fa62cbe503a req-64d5cec2-a88e-4e19-8b02-e7e3282f4231 service nova] Creating event network-changed:9c6d7ec3-4424-4f87-91d4-940819f13c02 for instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 on hv-cinder-79733 Jun 17 07:46:56.789918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-577b34a3-d10d-4bff-bac2-4fa62cbe503a req-64d5cec2-a88e-4e19-8b02-e7e3282f4231 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254646 Jun 17 07:46:56.790544 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 532/1081] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:46:57.101083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e5545af7-003c-4e3b-b7fd-02d037203409 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:57.102051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e5545af7-003c-4e3b-b7fd-02d037203409 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:57.108764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e5545af7-003c-4e3b-b7fd-02d037203409 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.109225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e5545af7-003c-4e3b-b7fd-02d037203409 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.110109 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e5545af7-003c-4e3b-b7fd-02d037203409 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.110578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e5545af7-003c-4e3b-b7fd-02d037203409 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.142433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e5545af7-003c-4e3b-b7fd-02d037203409 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045643 Jun 17 07:46:57.143014 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 550/1082] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:46:57 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:46:57.197876 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3fa651b8-ef8b-4407-abc1-9908a0677903 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:57.198673 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3fa651b8-ef8b-4407-abc1-9908a0677903 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:57.205114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3fa651b8-ef8b-4407-abc1-9908a0677903 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.205602 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3fa651b8-ef8b-4407-abc1-9908a0677903 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.211737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3fa651b8-ef8b-4407-abc1-9908a0677903 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.211737 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3fa651b8-ef8b-4407-abc1-9908a0677903 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.258551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1bb5554c-eb3f-465b-a95f-090b4535ba10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:57.259479 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1bb5554c-eb3f-465b-a95f-090b4535ba10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:57.265635 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1bb5554c-eb3f-465b-a95f-090b4535ba10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.266081 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1bb5554c-eb3f-465b-a95f-090b4535ba10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.266852 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1bb5554c-eb3f-465b-a95f-090b4535ba10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.267294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1bb5554c-eb3f-465b-a95f-090b4535ba10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.297396 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1bb5554c-eb3f-465b-a95f-090b4535ba10 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043055 Jun 17 07:46:57.298259 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 551/1083] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:46:57 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 07:46:57.359220 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1391db8b-8051-43c3-97a1-09887c89995e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:57.363121 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1391db8b-8051-43c3-97a1-09887c89995e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:57.366551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1391db8b-8051-43c3-97a1-09887c89995e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.367238 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1391db8b-8051-43c3-97a1-09887c89995e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.368026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1391db8b-8051-43c3-97a1-09887c89995e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.368455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1391db8b-8051-43c3-97a1-09887c89995e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.389821 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3fa651b8-ef8b-4407-abc1-9908a0677903 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:57.393977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1391db8b-8051-43c3-97a1-09887c89995e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Going to try to terminate instance {{(pid=124472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:46:57.397750 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3fa651b8-ef8b-4407-abc1-9908a0677903 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.205883 Jun 17 07:46:57.398322 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 533/1084] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:57 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:57.651671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1391db8b-8051-43c3-97a1-09887c89995e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 204 len: 0 microversion: 2.1 time: 0.295981 Jun 17 07:46:57.652262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 552/1085] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:46:57 2022] DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:46:57.660792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e145fcd2-f730-4a75-a3a5-64f7309e98f6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:57.661429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e145fcd2-f730-4a75-a3a5-64f7309e98f6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:57.663810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:57.668698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e145fcd2-f730-4a75-a3a5-64f7309e98f6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.669146 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e145fcd2-f730-4a75-a3a5-64f7309e98f6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.669942 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e145fcd2-f730-4a75-a3a5-64f7309e98f6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:57.670378 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e145fcd2-f730-4a75-a3a5-64f7309e98f6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:57.802621 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e145fcd2-f730-4a75-a3a5-64f7309e98f6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:57.810987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e145fcd2-f730-4a75-a3a5-64f7309e98f6 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1672 microversion: 2.1 time: 0.154343 Jun 17 07:46:57.811566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 534/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:57 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:58.415569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b5b419a1-399d-4f8c-b17a-965cd6ada2b7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:58.416303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b5b419a1-399d-4f8c-b17a-965cd6ada2b7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:58.422691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b5b419a1-399d-4f8c-b17a-965cd6ada2b7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:58.423135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b5b419a1-399d-4f8c-b17a-965cd6ada2b7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:58.423906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b5b419a1-399d-4f8c-b17a-965cd6ada2b7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:58.424334 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b5b419a1-399d-4f8c-b17a-965cd6ada2b7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:58.556950 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b5b419a1-399d-4f8c-b17a-965cd6ada2b7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:58.560441 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:46:58.564732 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b5b419a1-399d-4f8c-b17a-965cd6ada2b7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.153866 Jun 17 07:46:58.565315 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 553/1087] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:58 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:58.830669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0d76baca-1d7e-4cf8-8875-844e48f2a2e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:58.831274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0d76baca-1d7e-4cf8-8875-844e48f2a2e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:58.838196 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d76baca-1d7e-4cf8-8875-844e48f2a2e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:58.838977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d76baca-1d7e-4cf8-8875-844e48f2a2e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:58.843346 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d76baca-1d7e-4cf8-8875-844e48f2a2e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:58.843346 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0d76baca-1d7e-4cf8-8875-844e48f2a2e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:58.977509 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0d76baca-1d7e-4cf8-8875-844e48f2a2e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:58.984963 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0d76baca-1d7e-4cf8-8875-844e48f2a2e8 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1672 microversion: 2.1 time: 0.158237 Jun 17 07:46:58.985568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 535/1088] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:58 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:46:59.583061 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a36b6895-50a2-4f7b-a5c6-a939e95ce4a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:46:59.583661 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a36b6895-50a2-4f7b-a5c6-a939e95ce4a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:46:59.591020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a36b6895-50a2-4f7b-a5c6-a939e95ce4a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:59.591462 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a36b6895-50a2-4f7b-a5c6-a939e95ce4a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:59.592246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a36b6895-50a2-4f7b-a5c6-a939e95ce4a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:46:59.592674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a36b6895-50a2-4f7b-a5c6-a939e95ce4a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:46:59.722025 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a36b6895-50a2-4f7b-a5c6-a939e95ce4a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:46:59.729603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a36b6895-50a2-4f7b-a5c6-a939e95ce4a5 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.151278 Jun 17 07:46:59.730182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 554/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:59 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:00.004151 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-447e6cf7-6aea-45a6-a61c-414ca031c57b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:00.005554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-447e6cf7-6aea-45a6-a61c-414ca031c57b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:00.012132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-447e6cf7-6aea-45a6-a61c-414ca031c57b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:00.022020 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-447e6cf7-6aea-45a6-a61c-414ca031c57b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:00.022020 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-447e6cf7-6aea-45a6-a61c-414ca031c57b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:00.022020 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-447e6cf7-6aea-45a6-a61c-414ca031c57b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:00.220417 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-447e6cf7-6aea-45a6-a61c-414ca031c57b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:00.228663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-447e6cf7-6aea-45a6-a61c-414ca031c57b tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1672 microversion: 2.1 time: 0.229061 Jun 17 07:47:00.229241 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 536/1090] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:46:59 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1672 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:00.747275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-869e9316-178d-480b-adce-3089e9ea3999 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:00.747904 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-869e9316-178d-480b-adce-3089e9ea3999 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:00.754330 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-869e9316-178d-480b-adce-3089e9ea3999 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:00.754776 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-869e9316-178d-480b-adce-3089e9ea3999 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:00.755529 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-869e9316-178d-480b-adce-3089e9ea3999 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:00.756739 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-869e9316-178d-480b-adce-3089e9ea3999 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:00.889567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-869e9316-178d-480b-adce-3089e9ea3999 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:00.897466 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-869e9316-178d-480b-adce-3089e9ea3999 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.153728 Jun 17 07:47:00.898059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 555/1091] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:00 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:01.246010 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8c910f6a-a461-41e3-a8b3-4ca347b74cc5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:01.246625 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8c910f6a-a461-41e3-a8b3-4ca347b74cc5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:01.253113 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8c910f6a-a461-41e3-a8b3-4ca347b74cc5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:01.253629 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8c910f6a-a461-41e3-a8b3-4ca347b74cc5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:01.254402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8c910f6a-a461-41e3-a8b3-4ca347b74cc5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:01.254841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8c910f6a-a461-41e3-a8b3-4ca347b74cc5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:01.392728 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8c910f6a-a461-41e3-a8b3-4ca347b74cc5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:01.401093 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8c910f6a-a461-41e3-a8b3-4ca347b74cc5 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1672 microversion: 2.1 time: 0.159026 Jun 17 07:47:01.401712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 537/1092] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:01 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:01.918423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-41c3c190-b1c5-47b1-8338-84225743d179 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:01.918972 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-41c3c190-b1c5-47b1-8338-84225743d179 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:01.925401 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-41c3c190-b1c5-47b1-8338-84225743d179 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:01.925854 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-41c3c190-b1c5-47b1-8338-84225743d179 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:01.926612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-41c3c190-b1c5-47b1-8338-84225743d179 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:01.927049 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-41c3c190-b1c5-47b1-8338-84225743d179 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:02.056133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-41c3c190-b1c5-47b1-8338-84225743d179 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:02.063677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-41c3c190-b1c5-47b1-8338-84225743d179 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.149148 Jun 17 07:47:02.064261 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 556/1093] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:01 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:02.419553 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-50f64c06-fa34-44eb-a238-1da2513adffb tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:02.421116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-50f64c06-fa34-44eb-a238-1da2513adffb tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:02.427258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-50f64c06-fa34-44eb-a238-1da2513adffb tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:02.428424 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-50f64c06-fa34-44eb-a238-1da2513adffb tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:02.430362 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-50f64c06-fa34-44eb-a238-1da2513adffb tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:02.430996 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-50f64c06-fa34-44eb-a238-1da2513adffb tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:02.638636 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-50f64c06-fa34-44eb-a238-1da2513adffb tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:02.645630 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-50f64c06-fa34-44eb-a238-1da2513adffb tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1672 microversion: 2.1 time: 0.230426 Jun 17 07:47:02.646234 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 538/1094] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:02 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1672 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:03.080085 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-df98c3fd-ad49-41da-a20e-ce84efa0ca83 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:03.080704 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-df98c3fd-ad49-41da-a20e-ce84efa0ca83 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:03.087578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df98c3fd-ad49-41da-a20e-ce84efa0ca83 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:03.088024 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df98c3fd-ad49-41da-a20e-ce84efa0ca83 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:03.088790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df98c3fd-ad49-41da-a20e-ce84efa0ca83 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:03.089448 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-df98c3fd-ad49-41da-a20e-ce84efa0ca83 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:03.231353 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-2278912e-9a0f-4b9c-9753-adb549ba855f req-24b88e4b-33e2-4221-a159-c44d838a05a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d09958-4d1a-44e5-8f46-26f8d80d16b9", "name": "network-vif-deleted", "tag": "daddb6c3-f14b-4972-9ac5-16d7ce07bba1"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:03.235544 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-df98c3fd-ad49-41da-a20e-ce84efa0ca83 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:03.243980 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-df98c3fd-ad49-41da-a20e-ce84efa0ca83 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.167737 Jun 17 07:47:03.244902 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 557/1095] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:03 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:03.248260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-2278912e-9a0f-4b9c-9753-adb549ba855f req-24b88e4b-33e2-4221-a159-c44d838a05a1 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:03.248983 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-2278912e-9a0f-4b9c-9753-adb549ba855f req-24b88e4b-33e2-4221-a159-c44d838a05a1 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:03.263722 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-2278912e-9a0f-4b9c-9753-adb549ba855f req-24b88e4b-33e2-4221-a159-c44d838a05a1 service nova] Creating event network-vif-deleted:daddb6c3-f14b-4972-9ac5-16d7ce07bba1 for instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 on hv-cinder-79733 Jun 17 07:47:03.269053 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-2278912e-9a0f-4b9c-9753-adb549ba855f req-24b88e4b-33e2-4221-a159-c44d838a05a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041888 Jun 17 07:47:03.270022 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 539/1096] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:03.663350 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:03.664049 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:03.675137 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:03.675796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:03.676623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:03.677058 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:03.710549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:03.711091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:03.711599 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lazy-loading 'fault' on Instance uuid c0d09958-4d1a-44e5-8f46-26f8d80d16b9 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:47:03.753852 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9c07cf08d9c45479f9530efe9dcad2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae461627578a489a9a6a9569cee15eb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:03.761465 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f534d83e-a045-4344-82f9-383cf7143bc1 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 200 len: 1327 microversion: 2.1 time: 0.102550 Jun 17 07:47:03.762041 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 558/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:03 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:03.913451 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-76210871-3fb7-4d87-bd80-b204798e0aed req-50b02c5a-dd36-4924-868c-fb42a6da3a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87eef2c2-52d2-40f0-aa8d-6992dbba0198", "name": "network-vif-plugged", "status": "completed", "tag": "9c6d7ec3-4424-4f87-91d4-940819f13c02"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:03.921877 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-76210871-3fb7-4d87-bd80-b204798e0aed req-50b02c5a-dd36-4924-868c-fb42a6da3a50 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:03.922590 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-76210871-3fb7-4d87-bd80-b204798e0aed req-50b02c5a-dd36-4924-868c-fb42a6da3a50 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:03.934353 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-76210871-3fb7-4d87-bd80-b204798e0aed req-50b02c5a-dd36-4924-868c-fb42a6da3a50 service nova] Creating event network-vif-plugged:9c6d7ec3-4424-4f87-91d4-940819f13c02 for instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 on hv-cinder-79733 Jun 17 07:47:03.939143 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-76210871-3fb7-4d87-bd80-b204798e0aed req-50b02c5a-dd36-4924-868c-fb42a6da3a50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 Jun 17 07:47:03.939742 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 540/1098] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:04.263703 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-03742488-1d30-4845-9e3c-7f92020c5304 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:04.265033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-03742488-1d30-4845-9e3c-7f92020c5304 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:04.273700 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-03742488-1d30-4845-9e3c-7f92020c5304 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:04.274150 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-03742488-1d30-4845-9e3c-7f92020c5304 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:04.280800 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-03742488-1d30-4845-9e3c-7f92020c5304 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:04.280800 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-03742488-1d30-4845-9e3c-7f92020c5304 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:04.423541 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-03742488-1d30-4845-9e3c-7f92020c5304 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:04.431680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-03742488-1d30-4845-9e3c-7f92020c5304 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.174836 Jun 17 07:47:04.432247 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 559/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:04 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:04.780865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:04.781620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:04.788265 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:04.788714 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:04.789510 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:04.789953 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:04.803467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] HTTP exception thrown: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Request method failure captured: Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 HTTP/1.1 Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC75XtkH2fnRLdanT-GjQwYrtlkv7qpmYzvSPD8m1tBdZMjDLTsTUxoltYmV70_nUcbK3y8Exwl9jTthcQpodwn_7_UXRexrfKCuCipt7OryNLG_Sa7kkyZ5rBf5ZffyazjG66IV9911a8EPrceSBOJlESDkrXE8DTtzGcSyzx6t6nE Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:47:04.805082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: c9c07cf08d9c45479f9530efe9dcad2a Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:04.806930 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'c0d09958-4d1a-44e5-8f46-26f8d80d16b9'} Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:04.808123 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:04.809718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:04.811170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Returning 404 to user: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:04.811170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bf3e7da5-c86d-44f8-a601-48df0e2af61f tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 404 len: 111 microversion: 2.1 time: 0.029894 Jun 17 07:47:04.811170 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 541/1100] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:04 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:47:04.815549 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d169cb5d-688a-4de4-9771-a59c6b30c30e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '.version_select at 0x7fb06a61b9d0>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:04.906416 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d169cb5d-688a-4de4-9771-a59c6b30c30e tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888151330" status: 202 len: 0 microversion: 2.1 time: 0.094830 Jun 17 07:47:04.906990 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 560/1101] 10.222.0.52 () {58 vars in 1217 bytes} [Fri Jun 17 07:47:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888151330 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:47:05.448265 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d981a5a7-c807-4fe7-b0b1-be862cf78675 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:05.449573 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d981a5a7-c807-4fe7-b0b1-be862cf78675 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:05.456178 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d981a5a7-c807-4fe7-b0b1-be862cf78675 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:05.459887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d981a5a7-c807-4fe7-b0b1-be862cf78675 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:05.459887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d981a5a7-c807-4fe7-b0b1-be862cf78675 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:05.459887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d981a5a7-c807-4fe7-b0b1-be862cf78675 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:05.593601 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d981a5a7-c807-4fe7-b0b1-be862cf78675 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:05.603750 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d981a5a7-c807-4fe7-b0b1-be862cf78675 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1359 microversion: 2.1 time: 0.159332 Jun 17 07:47:05.604535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 542/1102] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:05 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:06.621159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-eee3f4b9-f8ae-4844-8d08-07a8704d7cce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:06.621812 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-eee3f4b9-f8ae-4844-8d08-07a8704d7cce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:06.623642 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:06.628397 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-eee3f4b9-f8ae-4844-8d08-07a8704d7cce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:06.628835 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-eee3f4b9-f8ae-4844-8d08-07a8704d7cce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:06.629621 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-eee3f4b9-f8ae-4844-8d08-07a8704d7cce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:06.630677 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-eee3f4b9-f8ae-4844-8d08-07a8704d7cce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:06.765539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-eee3f4b9-f8ae-4844-8d08-07a8704d7cce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:06.774266 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-eee3f4b9-f8ae-4844-8d08-07a8704d7cce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1548 microversion: 2.1 time: 0.157427 Jun 17 07:47:06.774849 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 561/1103] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:06 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:47:06.790966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9d06a789-b792-406e-b8c5-d51a794af489 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:06.791613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9d06a789-b792-406e-b8c5-d51a794af489 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:06.798350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d06a789-b792-406e-b8c5-d51a794af489 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:06.798803 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d06a789-b792-406e-b8c5-d51a794af489 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:06.799578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d06a789-b792-406e-b8c5-d51a794af489 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:06.800048 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9d06a789-b792-406e-b8c5-d51a794af489 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:06.931887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9d06a789-b792-406e-b8c5-d51a794af489 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:06.939415 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9d06a789-b792-406e-b8c5-d51a794af489 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1548 microversion: 2.1 time: 0.152833 Jun 17 07:47:06.939995 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 543/1104] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:06 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:06.956891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:06.960609 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:06.961433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Searching by: {'deleted': False, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd'} {{(pid=124472) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 17 07:47:06.968156 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:06.968612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:06.969696 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:06.970132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:07.062251 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.multi_cell_list [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124472) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 17 07:47:07.172172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-aa8d60e6-a64b-443b-bc21-6d8b27e0d333 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.220037 Jun 17 07:47:07.175811 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 562/1105] 10.222.0.52 () {58 vars in 1124 bytes} [Fri Jun 17 07:47:06 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:07.185702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f2e6877c-7dd0-4b18-ad9b-dcfacc2850b9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:07.186308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f2e6877c-7dd0-4b18-ad9b-dcfacc2850b9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:07.192205 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f2e6877c-7dd0-4b18-ad9b-dcfacc2850b9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:07.193194 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f2e6877c-7dd0-4b18-ad9b-dcfacc2850b9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:07.194212 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f2e6877c-7dd0-4b18-ad9b-dcfacc2850b9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:07.194649 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f2e6877c-7dd0-4b18-ad9b-dcfacc2850b9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:07.324269 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f2e6877c-7dd0-4b18-ad9b-dcfacc2850b9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:07.331788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f2e6877c-7dd0-4b18-ad9b-dcfacc2850b9 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1548 microversion: 2.1 time: 0.149924 Jun 17 07:47:07.332358 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 544/1106] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:07 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:08.183901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:08.184582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:08.191534 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:08.191972 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:08.193419 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:08.194008 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:08.207664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] HTTP exception thrown: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Request method failure captured: Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 HTTP/1.1 Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC75XtkH2fnRLdanT-GjQwYrtlkv7qpmYzvSPD8m1tBdZMjDLTsTUxoltYmV70_nUcbK3y8Exwl9jTthcQpodwn_7_UXRexrfKCuCipt7OryNLG_Sa7kkyZ5rBf5ZffyazjG66IV9911a8EPrceSBOJlESDkrXE8DTtzGcSyzx6t6nE Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:47:08.209232 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: c9c07cf08d9c45479f9530efe9dcad2a Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.210901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'c0d09958-4d1a-44e5-8f46-26f8d80d16b9'} Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:08.211934 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.213595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.215091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Returning 404 to user: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:08.215091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f8d46681-8882-42ae-b57d-481dc46a3a57 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 404 len: 111 microversion: 2.1 time: 0.030695 Jun 17 07:47:08.215091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 563/1107] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:47:08 2022] DELETE /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:47:08.219473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:08.220195 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: c0d09958-4d1a-44e5-8f46-26f8d80d16b9] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:08.227033 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:08.227475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:08.228322 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:08.228833 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:08.243740 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] HTTP exception thrown: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Request method failure captured: Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 HTTP/1.1 Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC75XtkH2fnRLdanT-GjQwYrtlkv7qpmYzvSPD8m1tBdZMjDLTsTUxoltYmV70_nUcbK3y8Exwl9jTthcQpodwn_7_UXRexrfKCuCipt7OryNLG_Sa7kkyZ5rBf5ZffyazjG66IV9911a8EPrceSBOJlESDkrXE8DTtzGcSyzx6t6nE Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:47:08.245274 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: c9c07cf08d9c45479f9530efe9dcad2a Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.248475 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'c0d09958-4d1a-44e5-8f46-26f8d80d16b9'} Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:08.249398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. Jun 17 07:47:08.250887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:08.252198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Returning 404 to user: Instance c0d09958-4d1a-44e5-8f46-26f8d80d16b9 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:08.252198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ba44f63f-7fc8-42a8-a99f-e2354839d32d tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9" status: 404 len: 111 microversion: 2.1 time: 0.031343 Jun 17 07:47:08.252198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 545/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:08 2022] GET /compute/v2.1/servers/c0d09958-4d1a-44e5-8f46-26f8d80d16b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:47:09.232653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5660ea65-693f-4419-97b3-0b2f51dfc771 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23c4922e-2f4f-4756-b1fa-93ea927f8072"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:09.233737 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5660ea65-693f-4419-97b3-0b2f51dfc771 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:09.241409 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5660ea65-693f-4419-97b3-0b2f51dfc771 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:09.241860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5660ea65-693f-4419-97b3-0b2f51dfc771 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:09.242619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5660ea65-693f-4419-97b3-0b2f51dfc771 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:09.243053 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5660ea65-693f-4419-97b3-0b2f51dfc771 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:09.476701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:09.477259 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:09.483761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:09.484211 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:09.485026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:09.485504 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:09.499698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] HTTP exception thrown: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Request method failure captured: Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: DELETE /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 HTTP/1.1 Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC75XtkH2fnRLdanT-GjQwYrtlkv7qpmYzvSPD8m1tBdZMjDLTsTUxoltYmV70_nUcbK3y8Exwl9jTthcQpodwn_7_UXRexrfKCuCipt7OryNLG_Sa7kkyZ5rBf5ZffyazjG66IV9911a8EPrceSBOJlESDkrXE8DTtzGcSyzx6t6nE Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:47:09.501237 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: c9c07cf08d9c45479f9530efe9dcad2a Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.502954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '8444090b-ae6f-4602-a407-fbc601de5625'} Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:09.503828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.511384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.513471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Returning 404 to user: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:09.513471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f62e68f2-ad68-44f7-8ffc-1216573d58b3 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 404 len: 111 microversion: 2.1 time: 0.030711 Jun 17 07:47:09.513471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 546/1109] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:47:09 2022] DELETE /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:47:09.513471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:09.513471 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] [instance: 8444090b-ae6f-4602-a407-fbc601de5625] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:09.518130 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:09.518571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:09.519376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:09.519807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] HTTP exception thrown: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Request method failure captured: Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 HTTP/1.1 Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC75XtkH2fnRLdanT-GjQwYrtlkv7qpmYzvSPD8m1tBdZMjDLTsTUxoltYmV70_nUcbK3y8Exwl9jTthcQpodwn_7_UXRexrfKCuCipt7OryNLG_Sa7kkyZ5rBf5ZffyazjG66IV9911a8EPrceSBOJlESDkrXE8DTtzGcSyzx6t6nE Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:47:09.536280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae461627578a489a9a6a9569cee15eb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: ae461627578a489a9a6a9569cee15eb8 Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeTestJSON-864558540 Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: c9c07cf08d9c45479f9530efe9dcad2a Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeTestJSON-864558540-project Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.538132 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '8444090b-ae6f-4602-a407-fbc601de5625'} Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:09.538993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. Jun 17 07:47:09.540429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:09.542121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] Returning 404 to user: Instance 8444090b-ae6f-4602-a407-fbc601de5625 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:09.542121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e583de4d-a0d3-46e1-a5c6-9a66c2073ce4 tempest-AttachVolumeTestJSON-864558540 tempest-AttachVolumeTestJSON-864558540-project] 10.222.0.52 "GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625" status: 404 len: 111 microversion: 2.1 time: 0.028918 Jun 17 07:47:09.542121 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 547/1110] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:09 2022] GET /compute/v2.1/servers/8444090b-ae6f-4602-a407-fbc601de5625 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:47:09.983819 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5660ea65-693f-4419-97b3-0b2f51dfc771 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "POST /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754490 Jun 17 07:47:09.984499 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 564/1111] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:47:09 2022] POST /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:47:18.647650 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-362e7582-9968-4c0b-9f4e-c50b82364522 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:18.648414 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-362e7582-9968-4c0b-9f4e-c50b82364522 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:18.654949 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-362e7582-9968-4c0b-9f4e-c50b82364522 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:18.657141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-362e7582-9968-4c0b-9f4e-c50b82364522 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:18.657141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-362e7582-9968-4c0b-9f4e-c50b82364522 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:18.657141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-362e7582-9968-4c0b-9f4e-c50b82364522 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:18.821685 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-362e7582-9968-4c0b-9f4e-c50b82364522 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:18.829960 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-362e7582-9968-4c0b-9f4e-c50b82364522 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1594 microversion: 2.1 time: 0.186330 Jun 17 07:47:18.834336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 548/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:18 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1594 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:18.990876 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d86b3490-0399-4909-b2c4-6872c942914c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:18.993102 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d86b3490-0399-4909-b2c4-6872c942914c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:19.008768 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:19.010943 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d86b3490-0399-4909-b2c4-6872c942914c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:19.011571 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d86b3490-0399-4909-b2c4-6872c942914c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:19.012515 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d86b3490-0399-4909-b2c4-6872c942914c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:19.021481 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d86b3490-0399-4909-b2c4-6872c942914c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:19.076076 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d86b3490-0399-4909-b2c4-6872c942914c tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.090582 Jun 17 07:47:19.077195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 565/1113] 10.222.0.52 () {60 vars in 1342 bytes} [Fri Jun 17 07:47:18 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:19.145371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5527699b-8b75-40c9-9f82-1bddbdce73fb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:19.147019 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5527699b-8b75-40c9-9f82-1bddbdce73fb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:19.155397 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5527699b-8b75-40c9-9f82-1bddbdce73fb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:19.156140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5527699b-8b75-40c9-9f82-1bddbdce73fb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:19.157182 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5527699b-8b75-40c9-9f82-1bddbdce73fb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:19.157862 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5527699b-8b75-40c9-9f82-1bddbdce73fb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:19.194343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5527699b-8b75-40c9-9f82-1bddbdce73fb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:47:19.532254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5527699b-8b75-40c9-9f82-1bddbdce73fb tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "DELETE /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 204 len: 0 microversion: 2.20 time: 0.391508 Jun 17 07:47:19.532980 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 549/1114] 10.222.0.52 () {60 vars in 1279 bytes} [Fri Jun 17 07:47:19 2022] DELETE /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 07:47:19.541211 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:19.541858 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:19.548656 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:19.549111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:19.549909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:19.551152 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:19.759909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:19.777146 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:19.780335 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:19.782051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2f0e2a80-42ff-4a51-80ee-35ce0d330637 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.244823 Jun 17 07:47:19.783589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 566/1115] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:47:19 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:47:20.806005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:20.807315 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:20.816792 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:20.818715 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:20.823186 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:20.826396 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:21.399908 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:21.403881 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:21.412621 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:21.414671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:21.448216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1621ae66-bc3a-4ae5-a7c7-b3f2ca14fec0 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1722 microversion: 2.20 time: 0.617162 Jun 17 07:47:21.448216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 550/1116] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:47:20 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1722 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:47:21.697365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-640df305-8c68-44f7-aebc-88f4343763ae tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: .version_select at 0x7fb06a5eb0d0>, body: {"keypair": {"name": "tempest-keypair-1046012107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgMZqEbq4oEgCURV4nbhXcMl6ROTmXM2rxOiMCD5Jv1skv+tpmIgEtp2pvLDonMMvlBMt8D/yeE1eoO5jHSH8Wvmd6hpQYWb6EJQiGfXKPo/YPeu2m3+iN8j7D4JOfmkg=="}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:21.711004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-640df305-8c68-44f7-aebc-88f4343763ae tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for project 2b6698fe4fa84871a3685aac8856970a. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:47:21.715307 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-640df305-8c68-44f7-aebc-88f4343763ae tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for user 3af78d3ebe2548f280d84fff4d6cb644 and project 2b6698fe4fa84871a3685aac8856970a. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:47:21.803941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-640df305-8c68-44f7-aebc-88f4343763ae tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.248814 Jun 17 07:47:21.803941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 567/1117] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:47:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:22.161916 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-67cd0127-a4e9-4ef4-a3e3-449757f91bf5 req-2f4d450a-f34d-4d53-8c2a-1278ce8e13f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eef2c2-52d2-40f0-aa8d-6992dbba0198", "tag": "9c6d7ec3-4424-4f87-91d4-940819f13c02"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:22.170917 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-67cd0127-a4e9-4ef4-a3e3-449757f91bf5 req-2f4d450a-f34d-4d53-8c2a-1278ce8e13f7 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:22.171359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-67cd0127-a4e9-4ef4-a3e3-449757f91bf5 req-2f4d450a-f34d-4d53-8c2a-1278ce8e13f7 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:22.210002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-67cd0127-a4e9-4ef4-a3e3-449757f91bf5 req-2f4d450a-f34d-4d53-8c2a-1278ce8e13f7 service nova] Creating event network-changed:9c6d7ec3-4424-4f87-91d4-940819f13c02 for instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 on hv-cinder-79733 Jun 17 07:47:22.220380 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-67cd0127-a4e9-4ef4-a3e3-449757f91bf5 req-2f4d450a-f34d-4d53-8c2a-1278ce8e13f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150813 Jun 17 07:47:22.226030 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 551/1118] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:22.463890 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:22.464504 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:22.471984 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:22.472518 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:22.474567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:22.483049 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:22.664480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:22.679856 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:22.683567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:22.687273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f0f35370-5847-4d78-b191-609656a27301 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1655 microversion: 2.20 time: 0.227531 Jun 17 07:47:22.690673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 568/1119] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:47:22 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1655 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:47:22.762965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-fb76846c-ad08-4d78-af7b-223d384b0fc6 req-e56393d2-fc98-4c1e-aaf3-1120cd5c4b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871cb913-ba89-4924-8a2c-ad61a797c36b", "name": "network-vif-deleted", "tag": "801e37b2-c880-4c3a-a5bd-cdf86430b915"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:22.780144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-fb76846c-ad08-4d78-af7b-223d384b0fc6 req-e56393d2-fc98-4c1e-aaf3-1120cd5c4b31 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:22.782336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-fb76846c-ad08-4d78-af7b-223d384b0fc6 req-e56393d2-fc98-4c1e-aaf3-1120cd5c4b31 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:22.809880 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-fb76846c-ad08-4d78-af7b-223d384b0fc6 req-e56393d2-fc98-4c1e-aaf3-1120cd5c4b31 service nova] Creating event network-vif-deleted:801e37b2-c880-4c3a-a5bd-cdf86430b915 for instance 871cb913-ba89-4924-8a2c-ad61a797c36b on hv-cinder-79733 Jun 17 07:47:22.824796 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-fb76846c-ad08-4d78-af7b-223d384b0fc6 req-e56393d2-fc98-4c1e-aaf3-1120cd5c4b31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065944 Jun 17 07:47:22.829249 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 552/1120] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:23.708393 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:23.709006 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:23.721624 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:23.722944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:23.726275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:23.726275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:23.788085 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:23.788717 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:23.789368 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lazy-loading 'fault' on Instance uuid 871cb913-ba89-4924-8a2c-ad61a797c36b {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:47:23.947555 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:23.957744 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:23.968742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ea40ad7d7546449f60539341abc545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8432e3c517624c449606ca1201f2be12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:23.973266 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9322516a-9113-468d-b8f7-fcd176640df3 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 200 len: 1371 microversion: 2.20 time: 0.267505 Jun 17 07:47:23.974498 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 569/1121] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:47:23 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:47:24.993893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:24.996030 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:25.005839 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:25.006929 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:25.009463 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:25.010402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:25.030209 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] HTTP exception thrown: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Request method failure captured: Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b HTTP/1.1 Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC6Nsmc1yzqvqKNjICcvO3dTRPXFb3dnL7cBj2sLip3Wz-omtLo3gsp53KXpLq_P1GEAwFFhoZvQTpA5RqtpK15pcOG5ivLeD9Jv5UVDO70e6SEphjHDipX4E4mUe1o2qX7f11CA9h-yzLTkV79EmGEvri41VrwTTEeDaoivEUJewoo Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:47:25.033133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8432e3c517624c449606ca1201f2be12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8432e3c517624c449606ca1201f2be12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: a3ea40ad7d7546449f60539341abc545 Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:25.035110 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '871cb913-ba89-4924-8a2c-ad61a797c36b'} Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:25.036086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:25.037854 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:25.041849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Returning 404 to user: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:25.058617 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c7fdd1ad-972a-4dca-b2ea-55955e798ba2 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 404 len: 111 microversion: 2.20 time: 0.054627 Jun 17 07:47:25.058617 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 553/1122] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:47:24 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:47:25.059513 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4393a54b-415e-4f4d-b1c1-25e37b4b0f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '.version_select at 0x7fb06a695940>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:25.196198 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4393a54b-415e-4f4d-b1c1-25e37b4b0f35 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-581966650" status: 204 len: 0 microversion: 2.20 time: 0.147388 Jun 17 07:47:25.197262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 570/1123] 10.222.0.52 () {60 vars in 1258 bytes} [Fri Jun 17 07:47:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-581966650 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 07:47:25.528760 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-24dff369-4e5d-45d2-acfd-dfcf1ccf8066 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:25.529276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-24dff369-4e5d-45d2-acfd-dfcf1ccf8066 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:25.536134 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-18455f4e-8170-4ea6-8870-3ccc5845b6b4 req-c1bce9a1-4ec4-439c-a5d8-8486eba763ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6def01-9ebf-4b6c-a559-59f912178f66", "tag": "4c771250-5a6d-4b03-9b41-002f7edfd23a"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:25.544646 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24dff369-4e5d-45d2-acfd-dfcf1ccf8066 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:25.545101 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24dff369-4e5d-45d2-acfd-dfcf1ccf8066 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:25.550778 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-18455f4e-8170-4ea6-8870-3ccc5845b6b4 req-c1bce9a1-4ec4-439c-a5d8-8486eba763ea service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:25.551513 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-18455f4e-8170-4ea6-8870-3ccc5845b6b4 req-c1bce9a1-4ec4-439c-a5d8-8486eba763ea service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:25.561424 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24dff369-4e5d-45d2-acfd-dfcf1ccf8066 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:25.563802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-24dff369-4e5d-45d2-acfd-dfcf1ccf8066 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:25.568075 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-18455f4e-8170-4ea6-8870-3ccc5845b6b4 req-c1bce9a1-4ec4-439c-a5d8-8486eba763ea service nova] Creating event network-changed:4c771250-5a6d-4b03-9b41-002f7edfd23a for instance fd6def01-9ebf-4b6c-a559-59f912178f66 on hv-cinder-79733 Jun 17 07:47:25.575514 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-18455f4e-8170-4ea6-8870-3ccc5845b6b4 req-c1bce9a1-4ec4-439c-a5d8-8486eba763ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042954 Jun 17 07:47:25.576643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 571/1124] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:47:25.625485 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-24dff369-4e5d-45d2-acfd-dfcf1ccf8066 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:47:25.827230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7f65ab35-bf7f-4501-933b-9d7894d39ef7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1010136990"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:25.827882 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7f65ab35-bf7f-4501-933b-9d7894d39ef7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:25.839588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7f65ab35-bf7f-4501-933b-9d7894d39ef7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:25.840155 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7f65ab35-bf7f-4501-933b-9d7894d39ef7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:25.841256 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7f65ab35-bf7f-4501-933b-9d7894d39ef7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:25.841906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7f65ab35-bf7f-4501-933b-9d7894d39ef7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:25.874901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:26.029084 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-24dff369-4e5d-45d2-acfd-dfcf1ccf8066 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 204 len: 0 microversion: 2.1 time: 0.506608 Jun 17 07:47:26.029811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 554/1125] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:47:25 2022] DELETE /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:47:26.036467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-914671646", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fe6f3e5-5a50-45b5-b064-863f94f19a5a"}], "security_groups": [{"name": "tempest-securitygroup--1868755975"}], "key_name": "tempest-keypair-1046012107", "user_data": "}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:26.173480 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] validate_networks() for [('4fe6f3e5-5a50-45b5-b064-863f94f19a5a', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:47:26.193533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.network.security_group_api [None req-7f65ab35-bf7f-4501-933b-9d7894d39ef7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Adding security group 2762b1b5-3a75-4b98-a7b4-cb2777dd9f63 to port 9c6d7ec3-4424-4f87-91d4-940819f13c02 Jun 17 07:47:26.794306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:47:26.794436 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:47:26.794836 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:47:26.795438 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:47:26.796006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:47:26.806309 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:26.813554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:26.813554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:26.813554 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:26.826578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for project 2b6698fe4fa84871a3685aac8856970a. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:47:26.831192 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for user 3af78d3ebe2548f280d84fff4d6cb644 and project 2b6698fe4fa84871a3685aac8856970a. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:47:26.843328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:47:26.846050 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:47:26.961780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-91c352fb-a828-419b-8a9e-0c5544f74694 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.930484 Jun 17 07:47:26.962352 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7f65ab35-bf7f-4501-933b-9d7894d39ef7 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "POST /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/action" status: 202 len: 0 microversion: 2.1 time: 1.139994 Jun 17 07:47:26.967865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 555/1126] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:47:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:47:26.968113 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 572/1127] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:47:25 2022] POST /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/action => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:47:26.971730 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-73dfa54a-3d93-44ee-9e80-5bec33aa184b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:26.972412 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-73dfa54a-3d93-44ee-9e80-5bec33aa184b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:26.982676 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-73dfa54a-3d93-44ee-9e80-5bec33aa184b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:26.983116 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-73dfa54a-3d93-44ee-9e80-5bec33aa184b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:26.983486 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9b4bdbf5-f1d6-4dd5-8d69-5066f0af5b44 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:26.984173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9b4bdbf5-f1d6-4dd5-8d69-5066f0af5b44 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:26.988322 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-73dfa54a-3d93-44ee-9e80-5bec33aa184b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:26.988797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-73dfa54a-3d93-44ee-9e80-5bec33aa184b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:26.999509 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b4bdbf5-f1d6-4dd5-8d69-5066f0af5b44 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:27.000144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b4bdbf5-f1d6-4dd5-8d69-5066f0af5b44 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:27.002133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b4bdbf5-f1d6-4dd5-8d69-5066f0af5b44 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:27.002575 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b4bdbf5-f1d6-4dd5-8d69-5066f0af5b44 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:27.290960 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-9b4bdbf5-f1d6-4dd5-8d69-5066f0af5b44 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:27.299403 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9b4bdbf5-f1d6-4dd5-8d69-5066f0af5b44 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1577 microversion: 2.1 time: 0.335926 Jun 17 07:47:27.300720 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 556/1128] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:26 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1577 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:27.306490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d2180ae8-75be-4f49-b193-19cf8993e97d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:27.307491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d2180ae8-75be-4f49-b193-19cf8993e97d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:27.380473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d2180ae8-75be-4f49-b193-19cf8993e97d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:27.391413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d2180ae8-75be-4f49-b193-19cf8993e97d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1241 microversion: 2.1 time: 0.089245 Jun 17 07:47:27.392116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 557/1129] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:27 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:27.416039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-73dfa54a-3d93-44ee-9e80-5bec33aa184b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:27.425279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-73dfa54a-3d93-44ee-9e80-5bec33aa184b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1759 microversion: 2.1 time: 0.457629 Jun 17 07:47:27.426398 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 573/1130] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:26 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1759 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:27.870540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-40a0cd44-b613-45ce-9f57-9da2bb774aa6 req-7c1f954f-06f5-4e3f-8c36-512b7bc8714e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eef2c2-52d2-40f0-aa8d-6992dbba0198", "tag": "9c6d7ec3-4424-4f87-91d4-940819f13c02"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:27.879085 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:27.888084 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-40a0cd44-b613-45ce-9f57-9da2bb774aa6 req-7c1f954f-06f5-4e3f-8c36-512b7bc8714e service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:27.894830 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-40a0cd44-b613-45ce-9f57-9da2bb774aa6 req-7c1f954f-06f5-4e3f-8c36-512b7bc8714e service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:27.910990 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-40a0cd44-b613-45ce-9f57-9da2bb774aa6 req-7c1f954f-06f5-4e3f-8c36-512b7bc8714e service nova] Creating event network-changed:9c6d7ec3-4424-4f87-91d4-940819f13c02 for instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 on hv-cinder-79733 Jun 17 07:47:27.915985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-40a0cd44-b613-45ce-9f57-9da2bb774aa6 req-7c1f954f-06f5-4e3f-8c36-512b7bc8714e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049721 Jun 17 07:47:27.916587 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 558/1131] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:28.246550 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:28.247055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:28.254117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.255066 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.255639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.256100 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.273128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] HTTP exception thrown: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Request method failure captured: Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b HTTP/1.1 Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6Nsmc1yzqvqKNjICcvO3dTRPXFb3dnL7cBj2sLip3Wz-omtLo3gsp53KXpLq_P1GEAwFFhoZvQTpA5RqtpK15pcOG5ivLeD9Jv5UVDO70e6SEphjHDipX4E4mUe1o2qX7f11CA9h-yzLTkV79EmGEvri41VrwTTEeDaoivEUJewoo Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:47:28.275277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8432e3c517624c449606ca1201f2be12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8432e3c517624c449606ca1201f2be12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: a3ea40ad7d7546449f60539341abc545 Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.276932 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '871cb913-ba89-4924-8a2c-ad61a797c36b'} Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:28.277891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.279797 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.288527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Returning 404 to user: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:28.288527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2bf307a6-4bce-4758-ac84-0dc57c84ca47 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "DELETE /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 404 len: 111 microversion: 2.20 time: 0.041978 Jun 17 07:47:28.288527 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 574/1132] 10.222.0.52 () {60 vars in 1279 bytes} [Fri Jun 17 07:47:28 2022] DELETE /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:47:28.302817 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:28.304314 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 871cb913-ba89-4924-8a2c-ad61a797c36b] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:28.324820 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.326688 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-158f2bdd-8624-4b0c-8d94-f20ecc2470a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:28.328169 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-158f2bdd-8624-4b0c-8d94-f20ecc2470a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:28.333127 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.334921 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.335462 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.354175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-158f2bdd-8624-4b0c-8d94-f20ecc2470a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.354944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-158f2bdd-8624-4b0c-8d94-f20ecc2470a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.355772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-158f2bdd-8624-4b0c-8d94-f20ecc2470a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.356215 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-158f2bdd-8624-4b0c-8d94-f20ecc2470a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.366960 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] HTTP exception thrown: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Request method failure captured: Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b HTTP/1.1 Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC6Nsmc1yzqvqKNjICcvO3dTRPXFb3dnL7cBj2sLip3Wz-omtLo3gsp53KXpLq_P1GEAwFFhoZvQTpA5RqtpK15pcOG5ivLeD9Jv5UVDO70e6SEphjHDipX4E4mUe1o2qX7f11CA9h-yzLTkV79EmGEvri41VrwTTEeDaoivEUJewoo Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:47:28.381142 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8432e3c517624c449606ca1201f2be12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8432e3c517624c449606ca1201f2be12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: a3ea40ad7d7546449f60539341abc545 Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.382927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '871cb913-ba89-4924-8a2c-ad61a797c36b'} Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:28.383832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. Jun 17 07:47:28.385263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:28.388081 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Returning 404 to user: Instance 871cb913-ba89-4924-8a2c-ad61a797c36b could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:28.388972 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2111fbe2-1f28-460b-9d92-b71a8cd32359 tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b" status: 404 len: 111 microversion: 2.20 time: 0.097901 Jun 17 07:47:28.389898 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 559/1133] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:47:28 2022] GET /compute/v2.1/servers/871cb913-ba89-4924-8a2c-ad61a797c36b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:47:28.423140 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-51f06158-a955-4612-b5f6-55562c228e73 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:28.425438 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-51f06158-a955-4612-b5f6-55562c228e73 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:28.443888 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51f06158-a955-4612-b5f6-55562c228e73 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.445950 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51f06158-a955-4612-b5f6-55562c228e73 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.448162 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51f06158-a955-4612-b5f6-55562c228e73 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.458496 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-51f06158-a955-4612-b5f6-55562c228e73 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.570718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-51f06158-a955-4612-b5f6-55562c228e73 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:28.579243 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-51f06158-a955-4612-b5f6-55562c228e73 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1245 microversion: 2.1 time: 0.173012 Jun 17 07:47:28.580083 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 560/1134] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:28 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1245 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:28.642861 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-158f2bdd-8624-4b0c-8d94-f20ecc2470a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:28.651828 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-158f2bdd-8624-4b0c-8d94-f20ecc2470a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1458 microversion: 2.1 time: 0.338081 Jun 17 07:47:28.652757 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 575/1135] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:28 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1458 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:47:28.882156 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-d47e5f3d-a8c1-426c-81ee-aa2ae9c3a959 req-ff5e7c67-fdb1-4471-ad64-3b4ef2fa99d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6def01-9ebf-4b6c-a559-59f912178f66", "name": "network-vif-deleted", "tag": "4c771250-5a6d-4b03-9b41-002f7edfd23a"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:28.890516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-d47e5f3d-a8c1-426c-81ee-aa2ae9c3a959 req-ff5e7c67-fdb1-4471-ad64-3b4ef2fa99d8 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:28.890966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-d47e5f3d-a8c1-426c-81ee-aa2ae9c3a959 req-ff5e7c67-fdb1-4471-ad64-3b4ef2fa99d8 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:28.902433 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-d47e5f3d-a8c1-426c-81ee-aa2ae9c3a959 req-ff5e7c67-fdb1-4471-ad64-3b4ef2fa99d8 service nova] Creating event network-vif-deleted:4c771250-5a6d-4b03-9b41-002f7edfd23a for instance fd6def01-9ebf-4b6c-a559-59f912178f66 on hv-cinder-79733 Jun 17 07:47:28.907467 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-d47e5f3d-a8c1-426c-81ee-aa2ae9c3a959 req-ff5e7c67-fdb1-4471-ad64-3b4ef2fa99d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029570 Jun 17 07:47:28.908189 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 561/1136] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:29.596862 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7ba06dfe-236f-462d-8071-26cab9067510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:29.597680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7ba06dfe-236f-462d-8071-26cab9067510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:29.604211 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ba06dfe-236f-462d-8071-26cab9067510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.604869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ba06dfe-236f-462d-8071-26cab9067510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.605729 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ba06dfe-236f-462d-8071-26cab9067510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.606151 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7ba06dfe-236f-462d-8071-26cab9067510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.670431 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:29.671441 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:29.686966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.687425 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.691536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.691536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.691889 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7ba06dfe-236f-462d-8071-26cab9067510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:29.699954 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7ba06dfe-236f-462d-8071-26cab9067510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1301 microversion: 2.1 time: 0.107656 Jun 17 07:47:29.700662 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 576/1137] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:29 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:29.736292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.737721 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.738054 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lazy-loading 'fault' on Instance uuid fd6def01-9ebf-4b6c-a559-59f912178f66 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:47:29.746524 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:29.747126 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:29.753574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.754436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.755440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.756227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.771164 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] HTTP exception thrown: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Request method failure captured: Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f HTTP/1.1 Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6Nsmc1yzqvqKNjICcvO3dTRPXFb3dnL7cBj2sLip3Wz-omtLo3gsp53KXpLq_P1GEAwFFhoZvQTpA5RqtpK15pcOG5ivLeD9Jv5UVDO70e6SEphjHDipX4E4mUe1o2qX7f11CA9h-yzLTkV79EmGEvri41VrwTTEeDaoivEUJewoo Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:47:29.773123 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8432e3c517624c449606ca1201f2be12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8432e3c517624c449606ca1201f2be12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: a3ea40ad7d7546449f60539341abc545 Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.779302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '69ad6743-cfda-46c3-afaa-6d54e2e80a2f'} Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:29.780236 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.781791 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.789493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Returning 404 to user: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:29.789493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3d20da0d-3456-49d2-b9ba-32d5d7da0e6d tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 404 len: 111 microversion: 2.20 time: 0.038357 Jun 17 07:47:29.789493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 577/1138] 10.222.0.52 () {60 vars in 1279 bytes} [Fri Jun 17 07:47:29 2022] DELETE /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 17 07:47:29.789493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:29.790254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:29.790452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] [instance: 69ad6743-cfda-46c3-afaa-6d54e2e80a2f] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:29.798523 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3325b0cb-05b6-4c24-9e18-310a64b0c2df tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 200 len: 1231 microversion: 2.1 time: 0.133268 Jun 17 07:47:29.800303 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 562/1139] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:29 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 1231 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:47:29.802525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.803060 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.804550 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:29.804689 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:29.820926 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] HTTP exception thrown: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Request method failure captured: Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f HTTP/1.1 Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC6Nsmc1yzqvqKNjICcvO3dTRPXFb3dnL7cBj2sLip3Wz-omtLo3gsp53KXpLq_P1GEAwFFhoZvQTpA5RqtpK15pcOG5ivLeD9Jv5UVDO70e6SEphjHDipX4E4mUe1o2qX7f11CA9h-yzLTkV79EmGEvri41VrwTTEeDaoivEUJewoo Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:47:29.822589 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8432e3c517624c449606ca1201f2be12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8432e3c517624c449606ca1201f2be12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8432e3c517624c449606ca1201f2be12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 8432e3c517624c449606ca1201f2be12 Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667887316 Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: a3ea40ad7d7546449f60539341abc545 Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667887316-project Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.825467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '69ad6743-cfda-46c3-afaa-6d54e2e80a2f'} Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:29.827003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. Jun 17 07:47:29.829843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:29.833624 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] Returning 404 to user: Instance 69ad6743-cfda-46c3-afaa-6d54e2e80a2f could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:29.833624 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b6087f72-ab01-47eb-a845-eba2475c180a tempest-AttachVolumeShelveTestJSON-1667887316 tempest-AttachVolumeShelveTestJSON-1667887316-project] 10.222.0.52 "GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f" status: 404 len: 111 microversion: 2.20 time: 0.043279 Jun 17 07:47:29.833624 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 578/1140] 10.222.0.52 () {60 vars in 1276 bytes} [Fri Jun 17 07:47:29 2022] GET /compute/v2.1/servers/69ad6743-cfda-46c3-afaa-6d54e2e80a2f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:47:30.718958 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0cfa73c2-7a57-4655-9de3-c6ee82608a66 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:30.719539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0cfa73c2-7a57-4655-9de3-c6ee82608a66 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:30.728920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0cfa73c2-7a57-4655-9de3-c6ee82608a66 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:30.729402 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0cfa73c2-7a57-4655-9de3-c6ee82608a66 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:30.730560 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0cfa73c2-7a57-4655-9de3-c6ee82608a66 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:30.731007 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0cfa73c2-7a57-4655-9de3-c6ee82608a66 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:30.816648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:30.817263 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: fd6def01-9ebf-4b6c-a559-59f912178f66] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:30.824951 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:30.825664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:30.826621 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:30.827231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:30.843182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] HTTP exception thrown: Instance fd6def01-9ebf-4b6c-a559-59f912178f66 could not be found. Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Request method failure captured: Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 HTTP/1.1 Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC7x1QV1pE2P0BTf8OF0T_YdHUGtLLNceXrrMgElDZxlxw8JOO5LlVfgKGqwJ4vTkDYv6OivZjZpwEzFpE0wZyt3BzumlPTb7UIJnyGAmDMjSRU5uJy57oSeIy-nLDWnoBVf6euifGAHqEVzjARmpwC2PMcyALEH03UxUBgrm7hoROY Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:47:30.844895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 781e29f49f27417a96cfc4ba00af95dd Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance fd6def01-9ebf-4b6c-a559-59f912178f66 could not be found. Jun 17 07:47:30.847172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'fd6def01-9ebf-4b6c-a559-59f912178f66'} Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd6def01-9ebf-4b6c-a559-59f912178f66 could not be found. Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:30.848193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd6def01-9ebf-4b6c-a559-59f912178f66 could not be found. Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd6def01-9ebf-4b6c-a559-59f912178f66 could not be found. Jun 17 07:47:30.849695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:30.851900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Returning 404 to user: Instance fd6def01-9ebf-4b6c-a559-59f912178f66 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:30.852807 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-12ded423-118f-4a62-a5d8-056535929640 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66" status: 404 len: 111 microversion: 2.1 time: 0.040847 Jun 17 07:47:30.853384 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 579/1141] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:30 2022] GET /compute/v2.1/servers/fd6def01-9ebf-4b6c-a559-59f912178f66 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:47:30.991308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0cfa73c2-7a57-4655-9de3-c6ee82608a66 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:30.999459 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0cfa73c2-7a57-4655-9de3-c6ee82608a66 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1367 microversion: 2.1 time: 0.284772 Jun 17 07:47:31.000472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 563/1142] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:30 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:31.522227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-10b14ebf-7943-449b-b043-990be6cc8270 req-e61938e8-a0b6-44ef-a563-4d5588d347f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67581984-cc79-4fe8-a92e-520ab5006ffe", "tag": "f5e1799a-1ce1-4d75-acdd-2d1629f8caf8"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:31.536106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-10b14ebf-7943-449b-b043-990be6cc8270 req-e61938e8-a0b6-44ef-a563-4d5588d347f7 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:31.536681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-10b14ebf-7943-449b-b043-990be6cc8270 req-e61938e8-a0b6-44ef-a563-4d5588d347f7 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:31.561500 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-10b14ebf-7943-449b-b043-990be6cc8270 req-e61938e8-a0b6-44ef-a563-4d5588d347f7 service nova] Creating event network-changed:f5e1799a-1ce1-4d75-acdd-2d1629f8caf8 for instance 67581984-cc79-4fe8-a92e-520ab5006ffe on hv-cinder-79733 Jun 17 07:47:31.568162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-10b14ebf-7943-449b-b043-990be6cc8270 req-e61938e8-a0b6-44ef-a563-4d5588d347f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051322 Jun 17 07:47:31.569141 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 580/1143] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:32.020982 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-f3a42e14-e298-4f6f-afa4-3f4383530323 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:32.020982 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-f3a42e14-e298-4f6f-afa4-3f4383530323 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:32.030788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f3a42e14-e298-4f6f-afa4-3f4383530323 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:32.031293 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f3a42e14-e298-4f6f-afa4-3f4383530323 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:32.032130 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f3a42e14-e298-4f6f-afa4-3f4383530323 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:32.032578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-f3a42e14-e298-4f6f-afa4-3f4383530323 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:32.209770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-f3a42e14-e298-4f6f-afa4-3f4383530323 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:32.224001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-f3a42e14-e298-4f6f-afa4-3f4383530323 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1367 microversion: 2.1 time: 0.207710 Jun 17 07:47:32.224598 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 564/1144] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:32 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:33.238039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=4 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:33.242944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-69ebf30f-9975-46b5-9ed3-c40d69095021 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:33.243727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-69ebf30f-9975-46b5-9ed3-c40d69095021 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:33.250231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-69ebf30f-9975-46b5-9ed3-c40d69095021 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:33.250638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-69ebf30f-9975-46b5-9ed3-c40d69095021 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:33.251408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-69ebf30f-9975-46b5-9ed3-c40d69095021 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:33.251828 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-69ebf30f-9975-46b5-9ed3-c40d69095021 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:33.474623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-69ebf30f-9975-46b5-9ed3-c40d69095021 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:33.482546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-69ebf30f-9975-46b5-9ed3-c40d69095021 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1367 microversion: 2.1 time: 0.245669 Jun 17 07:47:33.484417 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 581/1145] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:33 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:34.454285 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-af7f7d40-d5a1-4097-bbcd-aa9ad249fd72 req-910f708d-0744-4613-9c03-a880612bbc30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09674923-6d3d-4ad8-a777-4f1bfdeb77fc", "tag": "22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:34.456719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-dfbba5c1-8517-48d9-b59c-6042f40f4bf4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:34.462819 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dfbba5c1-8517-48d9-b59c-6042f40f4bf4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:34.467158 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-af7f7d40-d5a1-4097-bbcd-aa9ad249fd72 req-910f708d-0744-4613-9c03-a880612bbc30 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:34.467613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-af7f7d40-d5a1-4097-bbcd-aa9ad249fd72 req-910f708d-0744-4613-9c03-a880612bbc30 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:34.473297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dfbba5c1-8517-48d9-b59c-6042f40f4bf4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:34.474948 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dfbba5c1-8517-48d9-b59c-6042f40f4bf4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:34.475741 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dfbba5c1-8517-48d9-b59c-6042f40f4bf4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:34.476174 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-dfbba5c1-8517-48d9-b59c-6042f40f4bf4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:34.481108 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-af7f7d40-d5a1-4097-bbcd-aa9ad249fd72 req-910f708d-0744-4613-9c03-a880612bbc30 service nova] Creating event network-changed:22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7 for instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc on hv-cinder-79733 Jun 17 07:47:34.490017 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-af7f7d40-d5a1-4097-bbcd-aa9ad249fd72 req-910f708d-0744-4613-9c03-a880612bbc30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039231 Jun 17 07:47:34.496651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 582/1146] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:34.504424 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a381f6e1-54ee-46ad-98a7-85151384fce7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:34.505145 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a381f6e1-54ee-46ad-98a7-85151384fce7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:34.511911 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a381f6e1-54ee-46ad-98a7-85151384fce7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:34.512355 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a381f6e1-54ee-46ad-98a7-85151384fce7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:34.513131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a381f6e1-54ee-46ad-98a7-85151384fce7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:34.513591 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a381f6e1-54ee-46ad-98a7-85151384fce7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:34.516100 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-dfbba5c1-8517-48d9-b59c-6042f40f4bf4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:47:34.690902 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a381f6e1-54ee-46ad-98a7-85151384fce7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:34.699304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a381f6e1-54ee-46ad-98a7-85151384fce7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1367 microversion: 2.1 time: 0.201096 Jun 17 07:47:34.700097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 583/1147] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:34 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:34.873371 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-dfbba5c1-8517-48d9-b59c-6042f40f4bf4 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "DELETE /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 204 len: 0 microversion: 2.1 time: 0.429145 Jun 17 07:47:34.874297 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 565/1148] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:47:34 2022] DELETE /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:47:34.883604 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-05fe2641-850a-465a-8135-33ef12b7e42c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:34.884552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-05fe2641-850a-465a-8135-33ef12b7e42c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:34.891582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05fe2641-850a-465a-8135-33ef12b7e42c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:34.892106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05fe2641-850a-465a-8135-33ef12b7e42c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:34.893916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05fe2641-850a-465a-8135-33ef12b7e42c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:34.894417 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-05fe2641-850a-465a-8135-33ef12b7e42c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:35.093252 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-05fe2641-850a-465a-8135-33ef12b7e42c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:35.105944 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-05fe2641-850a-465a-8135-33ef12b7e42c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1577 microversion: 2.1 time: 0.226461 Jun 17 07:47:35.108885 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 584/1149] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:34 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:35.720119 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d03bdf33-4194-49e5-9870-e4aaf7e424dc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:35.722770 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d03bdf33-4194-49e5-9870-e4aaf7e424dc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:35.730942 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d03bdf33-4194-49e5-9870-e4aaf7e424dc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:35.731383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d03bdf33-4194-49e5-9870-e4aaf7e424dc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:35.732179 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d03bdf33-4194-49e5-9870-e4aaf7e424dc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:35.732610 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d03bdf33-4194-49e5-9870-e4aaf7e424dc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:35.879975 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d03bdf33-4194-49e5-9870-e4aaf7e424dc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:35.888466 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d03bdf33-4194-49e5-9870-e4aaf7e424dc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1367 microversion: 2.1 time: 0.174342 Jun 17 07:47:35.893807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 566/1150] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:35 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:36.132826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b44e7500-205a-4039-9fbb-3c62c991840c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:36.133567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b44e7500-205a-4039-9fbb-3c62c991840c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:36.140033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b44e7500-205a-4039-9fbb-3c62c991840c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:36.140703 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b44e7500-205a-4039-9fbb-3c62c991840c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:36.141693 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b44e7500-205a-4039-9fbb-3c62c991840c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:36.142314 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b44e7500-205a-4039-9fbb-3c62c991840c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:36.306374 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b44e7500-205a-4039-9fbb-3c62c991840c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:36.315655 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b44e7500-205a-4039-9fbb-3c62c991840c tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1577 microversion: 2.1 time: 0.186464 Jun 17 07:47:36.317603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 585/1151] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:36 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:36.378748 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-db9d8555-b7cc-4482-9b40-fa3419ada61b tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Action: 'create', calling method: .version_select at 0x7fb069c84af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1799048653", "metadata": {"Type": "work"}}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:36.744817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-4e0f76c1-46e8-4838-8681-cef43ed384b7 req-9d50642e-01de-4ad0-a253-bf9e7cfadfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09674923-6d3d-4ad8-a777-4f1bfdeb77fc", "name": "network-vif-deleted", "tag": "22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:36.752823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-4e0f76c1-46e8-4838-8681-cef43ed384b7 req-9d50642e-01de-4ad0-a253-bf9e7cfadfab service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:36.753270 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-4e0f76c1-46e8-4838-8681-cef43ed384b7 req-9d50642e-01de-4ad0-a253-bf9e7cfadfab service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:36.764401 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-4e0f76c1-46e8-4838-8681-cef43ed384b7 req-9d50642e-01de-4ad0-a253-bf9e7cfadfab service nova] Creating event network-vif-deleted:22d39d6a-e84a-4f9d-aecf-c2d8d2946fa7 for instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc on hv-cinder-79733 Jun 17 07:47:36.770041 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-4e0f76c1-46e8-4838-8681-cef43ed384b7 req-9d50642e-01de-4ad0-a253-bf9e7cfadfab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028786 Jun 17 07:47:36.770686 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 586/1152] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:47:36.815321 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:36.907326 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5a674c0f-d8a0-4b52-9268-b3fd39fd18b9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:36.908538 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5a674c0f-d8a0-4b52-9268-b3fd39fd18b9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:36.915165 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a674c0f-d8a0-4b52-9268-b3fd39fd18b9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:36.915613 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a674c0f-d8a0-4b52-9268-b3fd39fd18b9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:36.916436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a674c0f-d8a0-4b52-9268-b3fd39fd18b9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:36.916867 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a674c0f-d8a0-4b52-9268-b3fd39fd18b9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:37.045717 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-db9d8555-b7cc-4482-9b40-fa3419ada61b tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.841010 Jun 17 07:47:37.046374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 567/1153] 10.222.0.52 () {60 vars in 1155 bytes} [Fri Jun 17 07:47:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 842 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 07:47:37.059311 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-faf7c61e-6093-48dc-bcfb-a59650edc1ac tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Calling method '.version_select at 0x7fb069de2790>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:37.074707 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5a674c0f-d8a0-4b52-9268-b3fd39fd18b9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:37.083212 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5a674c0f-d8a0-4b52-9268-b3fd39fd18b9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1367 microversion: 2.1 time: 0.180239 Jun 17 07:47:37.083796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 587/1154] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:36 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:47:37.119904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-faf7c61e-6093-48dc-bcfb-a59650edc1ac tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198" status: 200 len: 353 microversion: 2.1 time: 0.065619 Jun 17 07:47:37.120481 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 568/1155] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:47:37 2022] GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:47:37.334565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e908e18f-f504-45ce-a35a-2fee4f703aac tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:37.336517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e908e18f-f504-45ce-a35a-2fee4f703aac tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:37.339033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:37.344094 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e908e18f-f504-45ce-a35a-2fee4f703aac tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:37.344712 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e908e18f-f504-45ce-a35a-2fee4f703aac tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:37.345555 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e908e18f-f504-45ce-a35a-2fee4f703aac tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:37.351253 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e908e18f-f504-45ce-a35a-2fee4f703aac tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:37.411162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e908e18f-f504-45ce-a35a-2fee4f703aac tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781e29f49f27417a96cfc4ba00af95dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8705999014cf43e1b1ccd5186b67b4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:37.419224 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e908e18f-f504-45ce-a35a-2fee4f703aac tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 200 len: 1226 microversion: 2.1 time: 0.089730 Jun 17 07:47:37.420540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 588/1156] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:37 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:37.803931 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=8 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:47:37.809059 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-df4008c1-4800-46de-a034-5e55589c5252 req-69a18bdd-8b21-4285-adc2-f5e4e7af6dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67581984-cc79-4fe8-a92e-520ab5006ffe", "name": "network-vif-plugged", "status": "completed", "tag": "f5e1799a-1ce1-4d75-acdd-2d1629f8caf8"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:37.819481 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-df4008c1-4800-46de-a034-5e55589c5252 req-69a18bdd-8b21-4285-adc2-f5e4e7af6dd5 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:37.820143 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-df4008c1-4800-46de-a034-5e55589c5252 req-69a18bdd-8b21-4285-adc2-f5e4e7af6dd5 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:37.831472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-df4008c1-4800-46de-a034-5e55589c5252 req-69a18bdd-8b21-4285-adc2-f5e4e7af6dd5 service nova] Creating event network-vif-plugged:f5e1799a-1ce1-4d75-acdd-2d1629f8caf8 for instance 67581984-cc79-4fe8-a92e-520ab5006ffe on hv-cinder-79733 Jun 17 07:47:37.836866 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-df4008c1-4800-46de-a034-5e55589c5252 req-69a18bdd-8b21-4285-adc2-f5e4e7af6dd5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Jun 17 07:47:37.837429 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 569/1157] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:38.100240 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5755d240-59cd-4f3d-9503-d053d06a24f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:38.100877 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5755d240-59cd-4f3d-9503-d053d06a24f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:38.107562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5755d240-59cd-4f3d-9503-d053d06a24f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:38.108005 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5755d240-59cd-4f3d-9503-d053d06a24f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:38.108759 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5755d240-59cd-4f3d-9503-d053d06a24f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:38.109195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5755d240-59cd-4f3d-9503-d053d06a24f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:38.133378 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9cbcc4ca-87f5-40af-a069-3a879c38cf42 tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Calling method '.version_select at 0x7fb069e2c9d0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:38.190128 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9cbcc4ca-87f5-40af-a069-3a879c38cf42 tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198" status: 200 len: 354 microversion: 2.1 time: 0.060364 Jun 17 07:47:38.191258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 570/1158] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:47:38 2022] GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:47:38.202751 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b88840d6-8cb3-4881-93bb-8c6a30cb0d02 tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Calling method '.version_select at 0x7fb069df21f0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:38.261567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5755d240-59cd-4f3d-9503-d053d06a24f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:38.263055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b88840d6-8cb3-4881-93bb-8c6a30cb0d02 tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198" status: 200 len: 354 microversion: 2.1 time: 0.064301 Jun 17 07:47:38.263632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 571/1159] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:47:38 2022] GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:47:38.270570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5755d240-59cd-4f3d-9503-d053d06a24f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1367 microversion: 2.1 time: 0.174303 Jun 17 07:47:38.271378 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 589/1160] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:38 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:38.280322 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3276da7c-5a93-48ca-a0d4-c16f32e9fa64 tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Calling method '.version_select at 0x7fb069c5f8b0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:38.437786 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:38.438382 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: 09674923-6d3d-4ad8-a777-4f1bfdeb77fc] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:38.445074 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:38.445566 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:38.446328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:38.446761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:38.457569 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3276da7c-5a93-48ca-a0d4-c16f32e9fa64 tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198" status: 202 len: 0 microversion: 2.1 time: 0.181235 Jun 17 07:47:38.458366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 572/1161] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:47:38 2022] DELETE /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:47:38.464619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] HTTP exception thrown: Instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc could not be found. Jun 17 07:47:38.465802 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2948aa25-29d0-4738-b416-27a53265dd52 tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Calling method '.version_select at 0x7fb069d71e50>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Request method failure captured: Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc HTTP/1.1 Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC7x1QV1pE2P0BTf8OF0T_YdHUGtLLNceXrrMgElDZxlxw8JOO5LlVfgKGqwJ4vTkDYv6OivZjZpwEzFpE0wZyt3BzumlPTb7UIJnyGAmDMjSRU5uJy57oSeIy-nLDWnoBVf6euifGAHqEVzjARmpwC2PMcyALEH03UxUBgrm7hoROY Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:47:38.466639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 781e29f49f27417a96cfc4ba00af95dd Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc could not be found. Jun 17 07:47:38.468106 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '09674923-6d3d-4ad8-a777-4f1bfdeb77fc'} Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc could not be found. Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:38.469493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc could not be found. Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc could not be found. Jun 17 07:47:38.472445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:38.477792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Returning 404 to user: Instance 09674923-6d3d-4ad8-a777-4f1bfdeb77fc could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:38.477792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2d8b10ed-6d96-4b17-bb12-56db51f791a7 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc" status: 404 len: 111 microversion: 2.1 time: 0.034174 Jun 17 07:47:38.477792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 590/1162] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:38 2022] GET /compute/v2.1/servers/09674923-6d3d-4ad8-a777-4f1bfdeb77fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:47:38.515892 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2948aa25-29d0-4738-b416-27a53265dd52 tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198" status: 200 len: 353 microversion: 2.1 time: 0.053581 Jun 17 07:47:38.518572 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 573/1163] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:47:38 2022] GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:47:38.974006 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:38.974492 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:38.980510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:38.980950 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:38.981730 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:38.982159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:38.995564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] HTTP exception thrown: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Request method failure captured: Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d HTTP/1.1 Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirC7x1QV1pE2P0BTf8OF0T_YdHUGtLLNceXrrMgElDZxlxw8JOO5LlVfgKGqwJ4vTkDYv6OivZjZpwEzFpE0wZyt3BzumlPTb7UIJnyGAmDMjSRU5uJy57oSeIy-nLDWnoBVf6euifGAHqEVzjARmpwC2PMcyALEH03UxUBgrm7hoROY Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:47:38.997083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 781e29f49f27417a96cfc4ba00af95dd Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:38.998687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'd5b922b8-4ba9-41d6-88a1-93b33e926c3d'} Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:38.999814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:39.001288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.002815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Returning 404 to user: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:39.002815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e7c0e4ab-6f24-4a77-9152-adf0bdbf31a5 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 404 len: 111 microversion: 2.1 time: 0.029358 Jun 17 07:47:39.002815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 591/1164] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:47:38 2022] DELETE /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:47:39.008545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:39.009276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [instance: d5b922b8-4ba9-41d6-88a1-93b33e926c3d] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:39.015568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:39.016039 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:39.021313 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:39.021313 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:39.031116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] HTTP exception thrown: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Request method failure captured: Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d HTTP/1.1 Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirC7x1QV1pE2P0BTf8OF0T_YdHUGtLLNceXrrMgElDZxlxw8JOO5LlVfgKGqwJ4vTkDYv6OivZjZpwEzFpE0wZyt3BzumlPTb7UIJnyGAmDMjSRU5uJy57oSeIy-nLDWnoBVf6euifGAHqEVzjARmpwC2PMcyALEH03UxUBgrm7hoROY Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:47:39.033374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8705999014cf43e1b1ccd5186b67b4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 8705999014cf43e1b1ccd5186b67b4bd Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-TestVolumeBootPattern-1184415131 Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 781e29f49f27417a96cfc4ba00af95dd Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-TestVolumeBootPattern-1184415131-project Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:39.035148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'd5b922b8-4ba9-41d6-88a1-93b33e926c3d'} Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:39.036000 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. Jun 17 07:47:39.037469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.038781 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Returning 404 to user: Instance d5b922b8-4ba9-41d6-88a1-93b33e926c3d could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:39.038781 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-3cf3ecd0-93f0-4a69-b383-c83cf5e331ea tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d" status: 404 len: 111 microversion: 2.1 time: 0.030595 Jun 17 07:47:39.038781 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 574/1165] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:39 2022] GET /compute/v2.1/servers/d5b922b8-4ba9-41d6-88a1-93b33e926c3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:47:39.288249 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9f4b5ab6-d095-45c2-83ce-6387ff338757 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:39.288853 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9f4b5ab6-d095-45c2-83ce-6387ff338757 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:39.294818 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9f4b5ab6-d095-45c2-83ce-6387ff338757 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:39.295287 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9f4b5ab6-d095-45c2-83ce-6387ff338757 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:39.296030 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9f4b5ab6-d095-45c2-83ce-6387ff338757 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:39.296475 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9f4b5ab6-d095-45c2-83ce-6387ff338757 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:39.431341 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9f4b5ab6-d095-45c2-83ce-6387ff338757 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:39.438734 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9f4b5ab6-d095-45c2-83ce-6387ff338757 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1367 microversion: 2.1 time: 0.154523 Jun 17 07:47:39.446183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 592/1166] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:39 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:39.530791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-37376f66-fcd2-4d31-ba21-fd7de45c0c0a tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Calling method '.version_select at 0x7fb069bcb3a0>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:39.560645 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-37376f66-fcd2-4d31-ba21-fd7de45c0c0a tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] HTTP exception thrown: Volume 040d5fd6-7630-4667-956a-437a3871a198 could not be found. Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-37376f66-fcd2-4d31-ba21-fd7de45c0c0a tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Request method failure captured: Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198 HTTP/1.1 Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDGYofXl1AxM75dz_rrGBBWHhAgQmzR4DDhiSHijNE4r2NlYhR_Hdynx1k-VA2oHaauz9c9xHLFIVknc0zBcjX3OGOzuUbdLFroZAQAm7DqO2MGXO3whBfSWg9McPAK6VAy7nyjCUAVUwno0RMPX8-s2e6F2arJjDrCUItfXvAgYo1M Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 0cd214928860448c92d3af6bdb15b661 Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-VolumesGetTestJSON-1071747862 Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:47:39.562614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0cd214928860448c92d3af6bdb15b661"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0cd214928860448c92d3af6bdb15b661"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0cd214928860448c92d3af6bdb15b661"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0cd214928860448c92d3af6bdb15b661"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-VolumesGetTestJSON-1071747862 Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 0cd214928860448c92d3af6bdb15b661 Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-VolumesGetTestJSON-1071747862 Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-VolumesGetTestJSON-1071747862-project Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 2bf6b84f54024f788551de2639479cb8 Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-VolumesGetTestJSON-1071747862-project Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Volume 040d5fd6-7630-4667-956a-437a3871a198 could not be found. Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '040d5fd6-7630-4667-956a-437a3871a198'} Jun 17 07:47:39.564911 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 040d5fd6-7630-4667-956a-437a3871a198 could not be found. (HTTP 404) (Request-ID: req-2fca6006-afa7-42bb-865f-4ff36372e9e6) Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:39.565985 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:47:39.567465 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 040d5fd6-7630-4667-956a-437a3871a198 could not be found. Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 07:47:39.568918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 040d5fd6-7630-4667-956a-437a3871a198 could not be found. Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 040d5fd6-7630-4667-956a-437a3871a198 could not be found. Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-37376f66-fcd2-4d31-ba21-fd7de45c0c0a tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] Returning 404 to user: Volume 040d5fd6-7630-4667-956a-437a3871a198 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-37376f66-fcd2-4d31-ba21-fd7de45c0c0a tempest-VolumesGetTestJSON-1071747862 tempest-VolumesGetTestJSON-1071747862-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198" status: 404 len: 109 microversion: 2.1 time: 0.037275 Jun 17 07:47:39.570538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 575/1167] 10.222.0.52 () {58 vars in 1244 bytes} [Fri Jun 17 07:47:39 2022] GET /compute/v2.1/os-volumes/040d5fd6-7630-4667-956a-437a3871a198 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:47:40.456819 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1be693fd-0a9a-4fdb-9f05-98d88b760232 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:40.457548 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1be693fd-0a9a-4fdb-9f05-98d88b760232 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:40.464459 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1be693fd-0a9a-4fdb-9f05-98d88b760232 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:40.466182 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1be693fd-0a9a-4fdb-9f05-98d88b760232 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:40.467289 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1be693fd-0a9a-4fdb-9f05-98d88b760232 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:40.467933 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1be693fd-0a9a-4fdb-9f05-98d88b760232 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:40.614931 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1be693fd-0a9a-4fdb-9f05-98d88b760232 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:47:40.622468 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1be693fd-0a9a-4fdb-9f05-98d88b760232 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1557 microversion: 2.1 time: 0.170283 Jun 17 07:47:40.623043 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 593/1168] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:47:40 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:47:40.641777 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-82943569-3ad7-4d5e-aacf-357ba8fda193 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] Calling method '.version_select at 0x7fb069e2cb80>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:40.645315 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82943569-3ad7-4d5e-aacf-357ba8fda193 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [4f969a53-3d2b-4f93-b432-97b78c4cde42] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 07:47:40.647289 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-54eb2494-fa4f-40c3-8e23-6caa48d8d949 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:47:40.648486 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-54eb2494-fa4f-40c3-8e23-6caa48d8d949 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:47:40.658267 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-54eb2494-fa4f-40c3-8e23-6caa48d8d949 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:40.659072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-54eb2494-fa4f-40c3-8e23-6caa48d8d949 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:40.659892 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-54eb2494-fa4f-40c3-8e23-6caa48d8d949 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:40.660334 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-54eb2494-fa4f-40c3-8e23-6caa48d8d949 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:40.768752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-54eb2494-fa4f-40c3-8e23-6caa48d8d949 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126202 Jun 17 07:47:40.769730 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 594/1169] 10.222.0.52 () {58 vars in 1274 bytes} [Fri Jun 17 07:47:40 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:41.653265 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO oslo.messaging._drivers.impl_rabbit [None req-82943569-3ad7-4d5e-aacf-357ba8fda193 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] [4f969a53-3d2b-4f93-b432-97b78c4cde42] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 50438. Jun 17 07:47:41.728574 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-82943569-3ad7-4d5e-aacf-357ba8fda193 tempest-TestVolumeBootPattern-1184415131 tempest-TestVolumeBootPattern-1184415131-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1192281260" status: 202 len: 0 microversion: 2.1 time: 1.093179 Jun 17 07:47:41.729373 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 576/1170] 10.222.0.52 () {58 vars in 1262 bytes} [Fri Jun 17 07:47:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1192281260 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:47:42.103163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-c6e4a4f9-354c-4487-90ed-0bb87a6ae1fa req-5bc5473f-1311-48b9-b298-faa090760c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67581984-cc79-4fe8-a92e-520ab5006ffe", "tag": "f5e1799a-1ce1-4d75-acdd-2d1629f8caf8"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:47:42.112399 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c6e4a4f9-354c-4487-90ed-0bb87a6ae1fa req-5bc5473f-1311-48b9-b298-faa090760c2e service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:47:42.112841 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c6e4a4f9-354c-4487-90ed-0bb87a6ae1fa req-5bc5473f-1311-48b9-b298-faa090760c2e service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:47:42.125263 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-c6e4a4f9-354c-4487-90ed-0bb87a6ae1fa req-5bc5473f-1311-48b9-b298-faa090760c2e service nova] Creating event network-changed:f5e1799a-1ce1-4d75-acdd-2d1629f8caf8 for instance 67581984-cc79-4fe8-a92e-520ab5006ffe on hv-cinder-79733 Jun 17 07:47:42.133213 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-c6e4a4f9-354c-4487-90ed-0bb87a6ae1fa req-5bc5473f-1311-48b9-b298-faa090760c2e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033440 Jun 17 07:47:42.134059 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 595/1171] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:47:55.102670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:47:55.103420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 07:47:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:48:35.531587 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:35.532343 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:35.536330 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-95196b9d-ca79-43d8-a7e0-21b6481563e3 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:48:35.537269 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-95196b9d-ca79-43d8-a7e0-21b6481563e3 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:35.543235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-95196b9d-ca79-43d8-a7e0-21b6481563e3 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:35.543690 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-95196b9d-ca79-43d8-a7e0-21b6481563e3 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:35.544578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-95196b9d-ca79-43d8-a7e0-21b6481563e3 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:35.545103 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-95196b9d-ca79-43d8-a7e0-21b6481563e3 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:35.760213 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-95196b9d-ca79-43d8-a7e0-21b6481563e3 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "POST /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/action" status: 202 len: 0 microversion: 2.1 time: 0.230017 Jun 17 07:48:35.760870 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 577/1172] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:48:35 2022] POST /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:48:35.767137 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=15 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:35.767871 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=96 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:48:35.772091 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f13d512f-32a8-47ea-b66f-45037cf745b6 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:35.772806 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f13d512f-32a8-47ea-b66f-45037cf745b6 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:35.779681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f13d512f-32a8-47ea-b66f-45037cf745b6 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:35.780127 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f13d512f-32a8-47ea-b66f-45037cf745b6 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:35.780916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f13d512f-32a8-47ea-b66f-45037cf745b6 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:35.781383 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f13d512f-32a8-47ea-b66f-45037cf745b6 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:35.935895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f13d512f-32a8-47ea-b66f-45037cf745b6 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:35.943909 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f13d512f-32a8-47ea-b66f-45037cf745b6 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1751 microversion: 2.1 time: 0.178698 Jun 17 07:48:35.944467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 596/1173] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:35 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:36.963369 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-55b1720e-7934-413f-b0d7-88a95a22d3a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:36.965014 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-55b1720e-7934-413f-b0d7-88a95a22d3a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:36.971725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-55b1720e-7934-413f-b0d7-88a95a22d3a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:36.979771 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-55b1720e-7934-413f-b0d7-88a95a22d3a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:36.979771 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-55b1720e-7934-413f-b0d7-88a95a22d3a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:36.979771 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-55b1720e-7934-413f-b0d7-88a95a22d3a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:37.123214 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-55b1720e-7934-413f-b0d7-88a95a22d3a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:37.131195 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-55b1720e-7934-413f-b0d7-88a95a22d3a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1751 microversion: 2.1 time: 0.173177 Jun 17 07:48:37.131759 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 578/1174] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:36 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:38.148752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9b6cef5f-d239-4457-896c-228eed28d2ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:38.149496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9b6cef5f-d239-4457-896c-228eed28d2ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:38.156330 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9b6cef5f-d239-4457-896c-228eed28d2ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:38.157210 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9b6cef5f-d239-4457-896c-228eed28d2ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:38.157561 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9b6cef5f-d239-4457-896c-228eed28d2ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:38.157998 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9b6cef5f-d239-4457-896c-228eed28d2ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:38.323576 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9b6cef5f-d239-4457-896c-228eed28d2ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:38.335857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9b6cef5f-d239-4457-896c-228eed28d2ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1751 microversion: 2.1 time: 0.190744 Jun 17 07:48:38.336556 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 597/1175] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:38 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:39.353848 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-376ee889-4cf7-4869-a777-2a600fc987ae tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:39.357163 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-376ee889-4cf7-4869-a777-2a600fc987ae tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:39.362680 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-376ee889-4cf7-4869-a777-2a600fc987ae tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:39.363126 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-376ee889-4cf7-4869-a777-2a600fc987ae tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:39.363901 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-376ee889-4cf7-4869-a777-2a600fc987ae tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:39.364344 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-376ee889-4cf7-4869-a777-2a600fc987ae tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:39.512410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-376ee889-4cf7-4869-a777-2a600fc987ae tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:39.520350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-376ee889-4cf7-4869-a777-2a600fc987ae tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.170392 Jun 17 07:48:39.522968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 579/1176] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:39 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:40.539274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-84a8934b-655b-4ac0-a460-535bbeadfc79 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:40.539923 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-84a8934b-655b-4ac0-a460-535bbeadfc79 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:40.546633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84a8934b-655b-4ac0-a460-535bbeadfc79 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:40.547086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84a8934b-655b-4ac0-a460-535bbeadfc79 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:40.547860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84a8934b-655b-4ac0-a460-535bbeadfc79 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:40.548300 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-84a8934b-655b-4ac0-a460-535bbeadfc79 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:40.703474 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-84a8934b-655b-4ac0-a460-535bbeadfc79 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:40.711752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-84a8934b-655b-4ac0-a460-535bbeadfc79 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.176283 Jun 17 07:48:40.712332 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 598/1177] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:40 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:41.730477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cde64cba-fe75-4775-a1f6-571b65f78c48 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:41.731088 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cde64cba-fe75-4775-a1f6-571b65f78c48 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:41.737586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cde64cba-fe75-4775-a1f6-571b65f78c48 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:41.738028 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cde64cba-fe75-4775-a1f6-571b65f78c48 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:41.738776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cde64cba-fe75-4775-a1f6-571b65f78c48 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:41.739204 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cde64cba-fe75-4775-a1f6-571b65f78c48 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:41.899306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-cde64cba-fe75-4775-a1f6-571b65f78c48 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:41.908438 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cde64cba-fe75-4775-a1f6-571b65f78c48 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.182538 Jun 17 07:48:41.909080 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 580/1178] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:41 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:42.925680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9ce823c1-6a85-40ae-b779-a6eecc81ab5b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:42.926282 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9ce823c1-6a85-40ae-b779-a6eecc81ab5b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:42.932320 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ce823c1-6a85-40ae-b779-a6eecc81ab5b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:42.932798 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ce823c1-6a85-40ae-b779-a6eecc81ab5b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:42.933604 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ce823c1-6a85-40ae-b779-a6eecc81ab5b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:42.934218 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ce823c1-6a85-40ae-b779-a6eecc81ab5b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:43.083327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9ce823c1-6a85-40ae-b779-a6eecc81ab5b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:43.092657 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9ce823c1-6a85-40ae-b779-a6eecc81ab5b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.170775 Jun 17 07:48:43.093364 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 599/1179] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:42 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:44.113643 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-16baf76e-fbd1-494e-8116-159745561a6b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:44.114679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-16baf76e-fbd1-494e-8116-159745561a6b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:44.125732 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-16baf76e-fbd1-494e-8116-159745561a6b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:44.126482 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-16baf76e-fbd1-494e-8116-159745561a6b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:44.127772 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-16baf76e-fbd1-494e-8116-159745561a6b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:44.128514 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-16baf76e-fbd1-494e-8116-159745561a6b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:44.281479 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-16baf76e-fbd1-494e-8116-159745561a6b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:44.289498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-16baf76e-fbd1-494e-8116-159745561a6b tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.182606 Jun 17 07:48:44.290064 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 581/1180] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:44 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:45.311129 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4136ac21-6feb-4f5b-a43c-e4af62f560fa tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:45.311716 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4136ac21-6feb-4f5b-a43c-e4af62f560fa tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:45.318443 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4136ac21-6feb-4f5b-a43c-e4af62f560fa tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:45.318884 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4136ac21-6feb-4f5b-a43c-e4af62f560fa tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:45.319643 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4136ac21-6feb-4f5b-a43c-e4af62f560fa tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:45.320072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4136ac21-6feb-4f5b-a43c-e4af62f560fa tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:45.486630 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4136ac21-6feb-4f5b-a43c-e4af62f560fa tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:45.495366 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4136ac21-6feb-4f5b-a43c-e4af62f560fa tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.187687 Jun 17 07:48:45.496132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 600/1181] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:45 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:46.511996 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-6bc6e31c-1c27-4c05-8baf-0d3f6df1863d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:46.512607 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-6bc6e31c-1c27-4c05-8baf-0d3f6df1863d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:46.519606 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6bc6e31c-1c27-4c05-8baf-0d3f6df1863d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:46.520046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6bc6e31c-1c27-4c05-8baf-0d3f6df1863d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:46.520861 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6bc6e31c-1c27-4c05-8baf-0d3f6df1863d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:46.521317 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-6bc6e31c-1c27-4c05-8baf-0d3f6df1863d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:46.670763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-6bc6e31c-1c27-4c05-8baf-0d3f6df1863d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:46.679725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-6bc6e31c-1c27-4c05-8baf-0d3f6df1863d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.171633 Jun 17 07:48:46.684490 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 582/1182] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:46 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:47.697434 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-39de75c9-8300-4305-8aa2-ebb8150442c4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:47.698070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-39de75c9-8300-4305-8aa2-ebb8150442c4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:47.705405 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-39de75c9-8300-4305-8aa2-ebb8150442c4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:47.705847 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-39de75c9-8300-4305-8aa2-ebb8150442c4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:47.706600 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-39de75c9-8300-4305-8aa2-ebb8150442c4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:47.707086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-39de75c9-8300-4305-8aa2-ebb8150442c4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:47.852533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-39de75c9-8300-4305-8aa2-ebb8150442c4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:47.861009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-39de75c9-8300-4305-8aa2-ebb8150442c4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.167456 Jun 17 07:48:47.861627 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 601/1183] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:47 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:48.879926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e29ebb6b-3e76-411e-b8f6-5d17462e6bd8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:48.880491 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e29ebb6b-3e76-411e-b8f6-5d17462e6bd8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:48.887926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e29ebb6b-3e76-411e-b8f6-5d17462e6bd8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:48.888366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e29ebb6b-3e76-411e-b8f6-5d17462e6bd8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:48.889158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e29ebb6b-3e76-411e-b8f6-5d17462e6bd8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:48.889627 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e29ebb6b-3e76-411e-b8f6-5d17462e6bd8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:49.040278 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e29ebb6b-3e76-411e-b8f6-5d17462e6bd8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:49.048929 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e29ebb6b-3e76-411e-b8f6-5d17462e6bd8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.173036 Jun 17 07:48:49.049547 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 583/1184] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:48 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:50.066168 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4dbc4d56-eb3e-497a-9f49-fb9e79bb83bb tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:50.066821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4dbc4d56-eb3e-497a-9f49-fb9e79bb83bb tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:50.074286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4dbc4d56-eb3e-497a-9f49-fb9e79bb83bb tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:50.074737 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4dbc4d56-eb3e-497a-9f49-fb9e79bb83bb tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:50.075503 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4dbc4d56-eb3e-497a-9f49-fb9e79bb83bb tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:50.075941 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4dbc4d56-eb3e-497a-9f49-fb9e79bb83bb tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:50.226035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-4dbc4d56-eb3e-497a-9f49-fb9e79bb83bb tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:50.238835 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4dbc4d56-eb3e-497a-9f49-fb9e79bb83bb tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.176422 Jun 17 07:48:50.239563 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 602/1185] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:50 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:51.257805 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-851062e2-1dbe-44ba-9fbd-3e46b324d20e tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:51.258386 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-851062e2-1dbe-44ba-9fbd-3e46b324d20e tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:51.265790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-851062e2-1dbe-44ba-9fbd-3e46b324d20e tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:51.266239 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-851062e2-1dbe-44ba-9fbd-3e46b324d20e tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:51.267224 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-851062e2-1dbe-44ba-9fbd-3e46b324d20e tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:51.267662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-851062e2-1dbe-44ba-9fbd-3e46b324d20e tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:51.412556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-851062e2-1dbe-44ba-9fbd-3e46b324d20e tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:51.420806 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-851062e2-1dbe-44ba-9fbd-3e46b324d20e tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.167096 Jun 17 07:48:51.421408 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 584/1186] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:51 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:52.438814 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d301022a-fa70-40fd-a36d-5409d81654ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:52.439406 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d301022a-fa70-40fd-a36d-5409d81654ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:52.446053 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d301022a-fa70-40fd-a36d-5409d81654ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:52.446493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d301022a-fa70-40fd-a36d-5409d81654ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:52.447252 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d301022a-fa70-40fd-a36d-5409d81654ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:52.448288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d301022a-fa70-40fd-a36d-5409d81654ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:52.602512 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d301022a-fa70-40fd-a36d-5409d81654ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:52.610832 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d301022a-fa70-40fd-a36d-5409d81654ce tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.175791 Jun 17 07:48:52.611428 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 603/1187] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:52 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:53.628394 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-c201faf5-d054-4bc8-97bb-e9e01a1985a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:53.629007 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-c201faf5-d054-4bc8-97bb-e9e01a1985a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:53.635905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c201faf5-d054-4bc8-97bb-e9e01a1985a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:53.645161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c201faf5-d054-4bc8-97bb-e9e01a1985a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:53.645161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c201faf5-d054-4bc8-97bb-e9e01a1985a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:53.645161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-c201faf5-d054-4bc8-97bb-e9e01a1985a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:53.782724 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-c201faf5-d054-4bc8-97bb-e9e01a1985a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:53.790680 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-c201faf5-d054-4bc8-97bb-e9e01a1985a8 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.166140 Jun 17 07:48:53.791444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 585/1188] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:53 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:54.808183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-526d6903-b920-474c-a755-9d892e979425 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:54.808792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-526d6903-b920-474c-a755-9d892e979425 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:54.815384 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-526d6903-b920-474c-a755-9d892e979425 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:54.815831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-526d6903-b920-474c-a755-9d892e979425 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:54.816595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-526d6903-b920-474c-a755-9d892e979425 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:54.817025 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-526d6903-b920-474c-a755-9d892e979425 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:54.964337 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-526d6903-b920-474c-a755-9d892e979425 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:54.972629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-526d6903-b920-474c-a755-9d892e979425 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1756 microversion: 2.1 time: 0.168293 Jun 17 07:48:54.973201 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 604/1189] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:54 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:48:55.989125 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bc8c015c-7b16-4c20-9399-d4effe004893 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:48:55.989722 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bc8c015c-7b16-4c20-9399-d4effe004893 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:48:55.997216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bc8c015c-7b16-4c20-9399-d4effe004893 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:55.997702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bc8c015c-7b16-4c20-9399-d4effe004893 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:55.998527 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bc8c015c-7b16-4c20-9399-d4effe004893 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:48:55.998978 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bc8c015c-7b16-4c20-9399-d4effe004893 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:48:56.411345 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-bc8c015c-7b16-4c20-9399-d4effe004893 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:48:56.420765 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bc8c015c-7b16-4c20-9399-d4effe004893 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1759 microversion: 2.1 time: 0.435570 Jun 17 07:48:56.421385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 586/1190] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:48:55 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1759 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:12.047456 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3604cd87-309c-4ae0-8923-50d5ba79b687 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:12.048036 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3604cd87-309c-4ae0-8923-50d5ba79b687 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:12.050472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=18 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:12.051125 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=54 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:12.056436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3604cd87-309c-4ae0-8923-50d5ba79b687 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:12.056877 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3604cd87-309c-4ae0-8923-50d5ba79b687 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:12.057653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3604cd87-309c-4ae0-8923-50d5ba79b687 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:12.058079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3604cd87-309c-4ae0-8923-50d5ba79b687 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:12.080633 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3604cd87-309c-4ae0-8923-50d5ba79b687 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/ips" status: 200 len: 150 microversion: 2.1 time: 0.037090 Jun 17 07:49:12.081204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 605/1191] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:49:12 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:49:14.865828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8a782ccd-b8e1-4d2a-9906-638eb0f2a471 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b544853d-ec3b-4bb0-9804-dd352638e260"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:49:14.866945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8a782ccd-b8e1-4d2a-9906-638eb0f2a471 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:14.870150 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=20 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:14.870804 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:14.875513 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8a782ccd-b8e1-4d2a-9906-638eb0f2a471 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:14.875957 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8a782ccd-b8e1-4d2a-9906-638eb0f2a471 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:14.876712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8a782ccd-b8e1-4d2a-9906-638eb0f2a471 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:14.877145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8a782ccd-b8e1-4d2a-9906-638eb0f2a471 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:15.733870 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8a782ccd-b8e1-4d2a-9906-638eb0f2a471 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871839 Jun 17 07:49:15.734505 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 587/1192] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:49:14 2022] POST /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:49:24.302537 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6452a75c-b0d1-4d77-b337-b793b9142ca4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: .version_select at 0x7fb06e556ca0>, body: {"keypair": {"name": "tempest-keypair-108451265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAucgGAF9wj5/AOVaBk8civYF621Y/a5RCsK+Pa/T+5yS2a94gcYgs5N1KjD3QgNv/vk4t0Jpg3eS9oaUaD8zNziFZSweBMSeuMiOgqIGv7k+wWzjY/3jEvflbGEcfCviw=="}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:49:24.317670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-6452a75c-b0d1-4d77-b337-b793b9142ca4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for project 2b6698fe4fa84871a3685aac8856970a. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:49:24.321823 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-6452a75c-b0d1-4d77-b337-b793b9142ca4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for user 3af78d3ebe2548f280d84fff4d6cb644 and project 2b6698fe4fa84871a3685aac8856970a. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:49:24.435866 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6452a75c-b0d1-4d77-b337-b793b9142ca4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.137224 Jun 17 07:49:24.436473 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 606/1193] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:49:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:49:26.825078 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:26.825919 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:26.830422 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1233239024", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fe6f3e5-5a50-45b5-b064-863f94f19a5a"}], "security_groups": [{"name": "tempest-securitygroup--1263620356"}], "key_name": "tempest-keypair-108451265", "user_data": "}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:49:27.146386 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] validate_networks() for [('4fe6f3e5-5a50-45b5-b064-863f94f19a5a', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:49:27.513357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:49:27.513778 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:49:27.514404 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:49:27.514902 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:49:27.515335 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:49:27.525583 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:27.526160 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:27.526954 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:27.527381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:27.544726 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for project 2b6698fe4fa84871a3685aac8856970a. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:49:27.548566 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for user 3af78d3ebe2548f280d84fff4d6cb644 and project 2b6698fe4fa84871a3685aac8856970a. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:49:27.560355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:49:27.562776 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:49:27.671360 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-54efb829-a05e-4859-b3c5-f82b234f5bdb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.848107 Jun 17 07:49:27.672027 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 588/1194] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:49:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:49:27.686143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ee8956c0-07c6-4a09-b36c-2f6bff4d4fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:27.687063 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ee8956c0-07c6-4a09-b36c-2f6bff4d4fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:27.859506 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ee8956c0-07c6-4a09-b36c-2f6bff4d4fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:27.869193 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ee8956c0-07c6-4a09-b36c-2f6bff4d4fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1241 microversion: 2.1 time: 0.190465 Jun 17 07:49:27.869782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 607/1195] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:27 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1241 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:28.886780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-439ea433-10b6-4382-af80-0fa0b12b5d76 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:28.887501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-439ea433-10b6-4382-af80-0fa0b12b5d76 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:28.894683 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-439ea433-10b6-4382-af80-0fa0b12b5d76 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:28.895114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-439ea433-10b6-4382-af80-0fa0b12b5d76 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:28.895871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-439ea433-10b6-4382-af80-0fa0b12b5d76 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:28.896303 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-439ea433-10b6-4382-af80-0fa0b12b5d76 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:28.984533 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-439ea433-10b6-4382-af80-0fa0b12b5d76 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:28.992889 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-439ea433-10b6-4382-af80-0fa0b12b5d76 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1245 microversion: 2.1 time: 0.109993 Jun 17 07:49:29.002470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 589/1196] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:28 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:49:30.010356 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-e9d0295f-6c5d-47ef-8e20-099c3cc992a9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:30.011009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-e9d0295f-6c5d-47ef-8e20-099c3cc992a9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:30.018051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e9d0295f-6c5d-47ef-8e20-099c3cc992a9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:30.018498 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e9d0295f-6c5d-47ef-8e20-099c3cc992a9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:30.019276 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e9d0295f-6c5d-47ef-8e20-099c3cc992a9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:30.019704 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-e9d0295f-6c5d-47ef-8e20-099c3cc992a9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:30.096678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-e9d0295f-6c5d-47ef-8e20-099c3cc992a9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:30.105588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-e9d0295f-6c5d-47ef-8e20-099c3cc992a9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1237 microversion: 2.1 time: 0.099153 Jun 17 07:49:30.106281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 608/1197] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:30 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:31.130912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-919fe12b-be25-4dbf-bfc7-441d18739c43 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:31.134722 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-919fe12b-be25-4dbf-bfc7-441d18739c43 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:31.149314 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-919fe12b-be25-4dbf-bfc7-441d18739c43 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:31.149871 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-919fe12b-be25-4dbf-bfc7-441d18739c43 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:31.150766 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-919fe12b-be25-4dbf-bfc7-441d18739c43 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:31.151413 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-919fe12b-be25-4dbf-bfc7-441d18739c43 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:31.220416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-919fe12b-be25-4dbf-bfc7-441d18739c43 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:31.237044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-919fe12b-be25-4dbf-bfc7-441d18739c43 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1311 microversion: 2.1 time: 0.111618 Jun 17 07:49:31.237044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 590/1198] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:31 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:32.253612 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6a3e8710-0df9-43cc-b375-8105062f2da2 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:32.254853 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6a3e8710-0df9-43cc-b375-8105062f2da2 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:32.264507 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6a3e8710-0df9-43cc-b375-8105062f2da2 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:32.265294 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6a3e8710-0df9-43cc-b375-8105062f2da2 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:32.282413 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6a3e8710-0df9-43cc-b375-8105062f2da2 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:32.283233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6a3e8710-0df9-43cc-b375-8105062f2da2 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:32.537079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-6a3e8710-0df9-43cc-b375-8105062f2da2 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:32.548694 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6a3e8710-0df9-43cc-b375-8105062f2da2 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.299823 Jun 17 07:49:32.549851 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 609/1199] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:32 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:32.773245 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-a8018d7e-c6d5-496d-9dd8-7f920b4287a8 req-0d66804c-95da-43c2-994a-1d7288c106d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3", "tag": "5def2155-8ddc-40d7-926a-4241a360ce25"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:49:32.789887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-a8018d7e-c6d5-496d-9dd8-7f920b4287a8 req-0d66804c-95da-43c2-994a-1d7288c106d2 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:32.790663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-a8018d7e-c6d5-496d-9dd8-7f920b4287a8 req-0d66804c-95da-43c2-994a-1d7288c106d2 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:32.811679 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-a8018d7e-c6d5-496d-9dd8-7f920b4287a8 req-0d66804c-95da-43c2-994a-1d7288c106d2 service nova] Creating event network-changed:5def2155-8ddc-40d7-926a-4241a360ce25 for instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 on hv-cinder-79733 Jun 17 07:49:32.817136 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-a8018d7e-c6d5-496d-9dd8-7f920b4287a8 req-0d66804c-95da-43c2-994a-1d7288c106d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050481 Jun 17 07:49:32.817894 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 591/1200] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:49:33.567809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-15c64a98-5a45-4b6c-a5b1-23ef9c38e2b7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:33.568385 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-15c64a98-5a45-4b6c-a5b1-23ef9c38e2b7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:33.575737 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-15c64a98-5a45-4b6c-a5b1-23ef9c38e2b7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:33.576176 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-15c64a98-5a45-4b6c-a5b1-23ef9c38e2b7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:33.576953 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-15c64a98-5a45-4b6c-a5b1-23ef9c38e2b7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:33.577402 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-15c64a98-5a45-4b6c-a5b1-23ef9c38e2b7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:33.716476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-15c64a98-5a45-4b6c-a5b1-23ef9c38e2b7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:33.723855 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-15c64a98-5a45-4b6c-a5b1-23ef9c38e2b7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.160523 Jun 17 07:49:33.724430 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 610/1201] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:33 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:34.741614 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a47b56f9-a231-46ae-9e40-dd4d38a7ff8d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:34.742312 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a47b56f9-a231-46ae-9e40-dd4d38a7ff8d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:34.748522 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a47b56f9-a231-46ae-9e40-dd4d38a7ff8d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:34.749026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a47b56f9-a231-46ae-9e40-dd4d38a7ff8d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:34.749819 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a47b56f9-a231-46ae-9e40-dd4d38a7ff8d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:34.750258 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a47b56f9-a231-46ae-9e40-dd4d38a7ff8d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:34.891819 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a47b56f9-a231-46ae-9e40-dd4d38a7ff8d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:34.899867 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a47b56f9-a231-46ae-9e40-dd4d38a7ff8d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.163161 Jun 17 07:49:34.900457 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 592/1202] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:34 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:35.918279 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-aa4c3a18-6470-43f5-9ec9-9e93746faf60 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:35.918888 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-aa4c3a18-6470-43f5-9ec9-9e93746faf60 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:35.925281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa4c3a18-6470-43f5-9ec9-9e93746faf60 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:35.925752 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa4c3a18-6470-43f5-9ec9-9e93746faf60 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:35.926502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa4c3a18-6470-43f5-9ec9-9e93746faf60 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:35.926931 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-aa4c3a18-6470-43f5-9ec9-9e93746faf60 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:36.055272 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-aa4c3a18-6470-43f5-9ec9-9e93746faf60 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:36.062538 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-aa4c3a18-6470-43f5-9ec9-9e93746faf60 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.148048 Jun 17 07:49:36.063128 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 611/1203] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:35 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:37.079883 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-97fb699a-ee6a-4648-9ebd-baf7d7c6a7b4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:37.080492 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-97fb699a-ee6a-4648-9ebd-baf7d7c6a7b4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:37.087543 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-97fb699a-ee6a-4648-9ebd-baf7d7c6a7b4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:37.088067 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-97fb699a-ee6a-4648-9ebd-baf7d7c6a7b4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:37.088830 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-97fb699a-ee6a-4648-9ebd-baf7d7c6a7b4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:37.089263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-97fb699a-ee6a-4648-9ebd-baf7d7c6a7b4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:37.222359 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-97fb699a-ee6a-4648-9ebd-baf7d7c6a7b4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:37.230181 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-97fb699a-ee6a-4648-9ebd-baf7d7c6a7b4 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.154139 Jun 17 07:49:37.230778 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 593/1204] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:37 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:38.246741 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d0176c1f-c383-4bbd-9e80-0f0317fb5e34 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:38.247346 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d0176c1f-c383-4bbd-9e80-0f0317fb5e34 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:38.249891 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:38.254831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d0176c1f-c383-4bbd-9e80-0f0317fb5e34 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:38.256836 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d0176c1f-c383-4bbd-9e80-0f0317fb5e34 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:38.256836 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d0176c1f-c383-4bbd-9e80-0f0317fb5e34 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:38.257370 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d0176c1f-c383-4bbd-9e80-0f0317fb5e34 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:38.397772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d0176c1f-c383-4bbd-9e80-0f0317fb5e34 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:38.405259 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d0176c1f-c383-4bbd-9e80-0f0317fb5e34 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.162409 Jun 17 07:49:38.406076 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 612/1205] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:38 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:49:39.423486 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-03f1ba7c-ca4d-4814-8c1f-c1f59058a5c9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:39.424082 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-03f1ba7c-ca4d-4814-8c1f-c1f59058a5c9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:39.426199 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:39.426882 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=6 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:49:39.432306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03f1ba7c-ca4d-4814-8c1f-c1f59058a5c9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:39.432749 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03f1ba7c-ca4d-4814-8c1f-c1f59058a5c9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:39.433540 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03f1ba7c-ca4d-4814-8c1f-c1f59058a5c9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:39.433970 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-03f1ba7c-ca4d-4814-8c1f-c1f59058a5c9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:39.580407 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-03f1ba7c-ca4d-4814-8c1f-c1f59058a5c9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:39.589206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-03f1ba7c-ca4d-4814-8c1f-c1f59058a5c9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.169611 Jun 17 07:49:39.589821 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 594/1206] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:39 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:40.608296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-fd6aba65-6565-4904-a4b2-5a4055cf1d4f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:40.608922 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-fd6aba65-6565-4904-a4b2-5a4055cf1d4f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:40.616750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd6aba65-6565-4904-a4b2-5a4055cf1d4f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:40.616750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd6aba65-6565-4904-a4b2-5a4055cf1d4f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:40.617313 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd6aba65-6565-4904-a4b2-5a4055cf1d4f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:40.617811 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-fd6aba65-6565-4904-a4b2-5a4055cf1d4f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:40.753721 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-fd6aba65-6565-4904-a4b2-5a4055cf1d4f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:40.762007 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-fd6aba65-6565-4904-a4b2-5a4055cf1d4f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.158394 Jun 17 07:49:40.762588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 613/1207] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:40 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:41.779630 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a481ddea-65c0-40c2-aecd-455cf4c86267 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:41.780310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a481ddea-65c0-40c2-aecd-455cf4c86267 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:41.786826 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a481ddea-65c0-40c2-aecd-455cf4c86267 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:41.787267 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a481ddea-65c0-40c2-aecd-455cf4c86267 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:41.788026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a481ddea-65c0-40c2-aecd-455cf4c86267 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:41.788454 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a481ddea-65c0-40c2-aecd-455cf4c86267 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:41.921758 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a481ddea-65c0-40c2-aecd-455cf4c86267 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:41.929055 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a481ddea-65c0-40c2-aecd-455cf4c86267 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.153495 Jun 17 07:49:41.929646 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 595/1208] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:41 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:42.946546 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-985840cb-b89e-4739-9d57-054eccbe221c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:42.947180 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-985840cb-b89e-4739-9d57-054eccbe221c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:42.953308 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-985840cb-b89e-4739-9d57-054eccbe221c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:42.953782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-985840cb-b89e-4739-9d57-054eccbe221c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:42.954567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-985840cb-b89e-4739-9d57-054eccbe221c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:42.954975 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-985840cb-b89e-4739-9d57-054eccbe221c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:43.091560 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-985840cb-b89e-4739-9d57-054eccbe221c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:43.099009 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-985840cb-b89e-4739-9d57-054eccbe221c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.156436 Jun 17 07:49:43.099565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 614/1209] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:42 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:43.257355 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-5e0bec2f-4188-4e78-97d3-dd1c354afef1 req-0f89dae2-abe5-4c19-8e09-4fb0519e77ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3", "name": "network-vif-plugged", "status": "completed", "tag": "5def2155-8ddc-40d7-926a-4241a360ce25"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:49:43.266641 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-5e0bec2f-4188-4e78-97d3-dd1c354afef1 req-0f89dae2-abe5-4c19-8e09-4fb0519e77ba service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:43.267090 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-5e0bec2f-4188-4e78-97d3-dd1c354afef1 req-0f89dae2-abe5-4c19-8e09-4fb0519e77ba service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:43.278969 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-5e0bec2f-4188-4e78-97d3-dd1c354afef1 req-0f89dae2-abe5-4c19-8e09-4fb0519e77ba service nova] Creating event network-vif-plugged:5def2155-8ddc-40d7-926a-4241a360ce25 for instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 on hv-cinder-79733 Jun 17 07:49:43.284236 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-5e0bec2f-4188-4e78-97d3-dd1c354afef1 req-0f89dae2-abe5-4c19-8e09-4fb0519e77ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030654 Jun 17 07:49:43.284832 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 596/1210] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:49:44.116085 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d8d436cc-7dbe-4bfa-aa0a-51309ff42c23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:44.116824 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d8d436cc-7dbe-4bfa-aa0a-51309ff42c23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:44.124111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d8d436cc-7dbe-4bfa-aa0a-51309ff42c23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:44.124557 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d8d436cc-7dbe-4bfa-aa0a-51309ff42c23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:44.125349 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d8d436cc-7dbe-4bfa-aa0a-51309ff42c23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:44.125770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d8d436cc-7dbe-4bfa-aa0a-51309ff42c23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:44.264569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d8d436cc-7dbe-4bfa-aa0a-51309ff42c23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:44.272014 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d8d436cc-7dbe-4bfa-aa0a-51309ff42c23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.159831 Jun 17 07:49:44.272579 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 615/1211] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:44 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:45.290423 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-81a9aa78-4c61-4f25-889b-87408b1267c5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:45.291146 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-81a9aa78-4c61-4f25-889b-87408b1267c5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:45.298221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81a9aa78-4c61-4f25-889b-87408b1267c5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:45.298671 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81a9aa78-4c61-4f25-889b-87408b1267c5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:45.299580 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81a9aa78-4c61-4f25-889b-87408b1267c5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:45.299915 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-81a9aa78-4c61-4f25-889b-87408b1267c5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:45.436389 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-81a9aa78-4c61-4f25-889b-87408b1267c5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:45.444009 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-81a9aa78-4c61-4f25-889b-87408b1267c5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.158119 Jun 17 07:49:45.444591 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 597/1212] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:45 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:46.461900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c911c22d-9d0e-4af4-a7d7-a0cdc83fbbc7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:46.462596 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c911c22d-9d0e-4af4-a7d7-a0cdc83fbbc7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:46.469451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c911c22d-9d0e-4af4-a7d7-a0cdc83fbbc7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:46.469895 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c911c22d-9d0e-4af4-a7d7-a0cdc83fbbc7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:46.470664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c911c22d-9d0e-4af4-a7d7-a0cdc83fbbc7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:46.471090 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c911c22d-9d0e-4af4-a7d7-a0cdc83fbbc7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:46.608042 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c911c22d-9d0e-4af4-a7d7-a0cdc83fbbc7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:46.615529 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c911c22d-9d0e-4af4-a7d7-a0cdc83fbbc7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.158188 Jun 17 07:49:46.616054 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 616/1213] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:46 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:49:47.632401 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-912dbd8e-4d19-4169-b84b-8c5ae80c3d13 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:47.633098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-912dbd8e-4d19-4169-b84b-8c5ae80c3d13 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:47.640697 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-912dbd8e-4d19-4169-b84b-8c5ae80c3d13 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:47.641151 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-912dbd8e-4d19-4169-b84b-8c5ae80c3d13 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:47.641968 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-912dbd8e-4d19-4169-b84b-8c5ae80c3d13 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:47.642400 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-912dbd8e-4d19-4169-b84b-8c5ae80c3d13 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:47.774567 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-912dbd8e-4d19-4169-b84b-8c5ae80c3d13 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:47.782071 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-912dbd8e-4d19-4169-b84b-8c5ae80c3d13 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.153766 Jun 17 07:49:47.782678 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 598/1214] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:47 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:48.799181 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1900e228-88e8-40c7-b362-d1734fd61a7c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:48.799794 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1900e228-88e8-40c7-b362-d1734fd61a7c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:48.806565 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1900e228-88e8-40c7-b362-d1734fd61a7c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:48.807007 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1900e228-88e8-40c7-b362-d1734fd61a7c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:48.807754 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1900e228-88e8-40c7-b362-d1734fd61a7c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:48.808180 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-1900e228-88e8-40c7-b362-d1734fd61a7c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:48.946338 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1900e228-88e8-40c7-b362-d1734fd61a7c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:48.953737 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1900e228-88e8-40c7-b362-d1734fd61a7c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.158372 Jun 17 07:49:48.954324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 617/1215] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:48 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:49.971052 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fecd0058-829c-46f2-ac71-09b6002dd642 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:49.971615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fecd0058-829c-46f2-ac71-09b6002dd642 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:49.979098 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fecd0058-829c-46f2-ac71-09b6002dd642 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:49.979536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fecd0058-829c-46f2-ac71-09b6002dd642 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:49.980298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fecd0058-829c-46f2-ac71-09b6002dd642 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:49.980729 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fecd0058-829c-46f2-ac71-09b6002dd642 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:50.116488 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-fecd0058-829c-46f2-ac71-09b6002dd642 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:50.124001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fecd0058-829c-46f2-ac71-09b6002dd642 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1367 microversion: 2.1 time: 0.156918 Jun 17 07:49:50.124579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 599/1216] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:49 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:51.140918 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-633df3af-82b4-47db-8398-d4a6a7457276 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:51.141555 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-633df3af-82b4-47db-8398-d4a6a7457276 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:51.147991 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-633df3af-82b4-47db-8398-d4a6a7457276 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:51.148962 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-633df3af-82b4-47db-8398-d4a6a7457276 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:51.149742 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-633df3af-82b4-47db-8398-d4a6a7457276 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:51.150175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-633df3af-82b4-47db-8398-d4a6a7457276 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:51.283786 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-633df3af-82b4-47db-8398-d4a6a7457276 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:49:51.292162 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-633df3af-82b4-47db-8398-d4a6a7457276 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1558 microversion: 2.1 time: 0.155072 Jun 17 07:49:51.293492 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 618/1217] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:49:51 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:49:51.308571 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-886a91d5-c2a5-4b2a-b679-e51e7dacbd94 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:49:51.309108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-886a91d5-c2a5-4b2a-b679-e51e7dacbd94 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:49:51.315844 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-886a91d5-c2a5-4b2a-b679-e51e7dacbd94 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:51.316288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-886a91d5-c2a5-4b2a-b679-e51e7dacbd94 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:51.322267 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-886a91d5-c2a5-4b2a-b679-e51e7dacbd94 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:51.322267 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-886a91d5-c2a5-4b2a-b679-e51e7dacbd94 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:51.400222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-886a91d5-c2a5-4b2a-b679-e51e7dacbd94 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095509 Jun 17 07:49:51.400865 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 600/1218] 10.222.0.52 () {58 vars in 1274 bytes} [Fri Jun 17 07:49:51 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:49:52.480678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-22bfda6a-4d51-4ea1-b49b-64c80c449f7f req-02d50d5c-b2e2-4855-8e3b-dc1ce6553a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3", "tag": "5def2155-8ddc-40d7-926a-4241a360ce25"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:49:52.486669 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-22bfda6a-4d51-4ea1-b49b-64c80c449f7f req-02d50d5c-b2e2-4855-8e3b-dc1ce6553a94 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:49:52.487114 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-22bfda6a-4d51-4ea1-b49b-64c80c449f7f req-02d50d5c-b2e2-4855-8e3b-dc1ce6553a94 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:49:52.502052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-22bfda6a-4d51-4ea1-b49b-64c80c449f7f req-02d50d5c-b2e2-4855-8e3b-dc1ce6553a94 service nova] Creating event network-changed:5def2155-8ddc-40d7-926a-4241a360ce25 for instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 on hv-cinder-79733 Jun 17 07:49:52.508471 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-22bfda6a-4d51-4ea1-b49b-64c80c449f7f req-02d50d5c-b2e2-4855-8e3b-dc1ce6553a94 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034475 Jun 17 07:49:52.509242 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 619/1219] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:50:08.230615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:08.231376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=64 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:08.235339 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-fc07a98f-40ff-4241-b8de-4531c5e5dc04 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1010136990"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:50:08.235870 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-fc07a98f-40ff-4241-b8de-4531c5e5dc04 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:08.249311 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc07a98f-40ff-4241-b8de-4531c5e5dc04 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:08.249311 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc07a98f-40ff-4241-b8de-4531c5e5dc04 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:08.249311 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc07a98f-40ff-4241-b8de-4531c5e5dc04 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:08.249311 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-fc07a98f-40ff-4241-b8de-4531c5e5dc04 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:08.374734 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.network.security_group_api [None req-fc07a98f-40ff-4241-b8de-4531c5e5dc04 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Removing security group 2762b1b5-3a75-4b98-a7b4-cb2777dd9f63 from port 9c6d7ec3-4424-4f87-91d4-940819f13c02 Jun 17 07:50:08.807298 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-fc07a98f-40ff-4241-b8de-4531c5e5dc04 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "POST /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/action" status: 202 len: 0 microversion: 2.1 time: 0.578446 Jun 17 07:50:08.823724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-b4c2d3e4-3b12-46f4-bf00-403bd48fcc4f req-e5a0e302-ab05-4c5f-a877-c16622e1c645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eef2c2-52d2-40f0-aa8d-6992dbba0198", "tag": "9c6d7ec3-4424-4f87-91d4-940819f13c02"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:50:08.860838 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 601/1220] 10.222.0.52 () {60 vars in 1277 bytes} [Fri Jun 17 07:50:08 2022] POST /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:50:08.861454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:08.861454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=72 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:50:08.861454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-b4c2d3e4-3b12-46f4-bf00-403bd48fcc4f req-e5a0e302-ab05-4c5f-a877-c16622e1c645 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:08.861454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-b4c2d3e4-3b12-46f4-bf00-403bd48fcc4f req-e5a0e302-ab05-4c5f-a877-c16622e1c645 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:08.861454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-b4c2d3e4-3b12-46f4-bf00-403bd48fcc4f req-e5a0e302-ab05-4c5f-a877-c16622e1c645 service nova] Creating event network-changed:9c6d7ec3-4424-4f87-91d4-940819f13c02 for instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 on hv-cinder-79733 Jun 17 07:50:08.861961 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-b4c2d3e4-3b12-46f4-bf00-403bd48fcc4f req-e5a0e302-ab05-4c5f-a877-c16622e1c645 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047816 Jun 17 07:50:08.862900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 620/1221] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:50:10.374053 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-729d2004-9947-4a42-85b7-a2212b4719a4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:10.374576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-729d2004-9947-4a42-85b7-a2212b4719a4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:10.381058 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-729d2004-9947-4a42-85b7-a2212b4719a4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:10.381058 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-729d2004-9947-4a42-85b7-a2212b4719a4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:10.382248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-729d2004-9947-4a42-85b7-a2212b4719a4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:10.382572 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-729d2004-9947-4a42-85b7-a2212b4719a4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:10.465638 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-729d2004-9947-4a42-85b7-a2212b4719a4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lazy-loading 'services' on Instance uuid 87eef2c2-52d2-40f0-aa8d-6992dbba0198 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:50:10.748830 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-729d2004-9947-4a42-85b7-a2212b4719a4 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "DELETE /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments/23c4922e-2f4f-4756-b1fa-93ea927f8072" status: 202 len: 0 microversion: 2.1 time: 0.379647 Jun 17 07:50:10.749693 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 602/1222] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:50:10 2022] DELETE /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments/23c4922e-2f4f-4756-b1fa-93ea927f8072 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:50:10.759356 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-01285ad7-72e1-48c6-a7ed-8945ecf2715a tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:10.761357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-01285ad7-72e1-48c6-a7ed-8945ecf2715a tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:10.769053 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-01285ad7-72e1-48c6-a7ed-8945ecf2715a tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:10.769597 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-01285ad7-72e1-48c6-a7ed-8945ecf2715a tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:10.773283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-01285ad7-72e1-48c6-a7ed-8945ecf2715a tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:10.773283 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-01285ad7-72e1-48c6-a7ed-8945ecf2715a tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:10.805270 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-01285ad7-72e1-48c6-a7ed-8945ecf2715a tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050782 Jun 17 07:50:10.805901 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 621/1223] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:50:10 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:50:10.881439 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-90270d83-3977-4d2f-b799-87173ca48ec6 req-0037f021-77bb-4101-a4de-9dbf40fb147d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87eef2c2-52d2-40f0-aa8d-6992dbba0198", "tag": "9c6d7ec3-4424-4f87-91d4-940819f13c02"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:50:10.890251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-90270d83-3977-4d2f-b799-87173ca48ec6 req-0037f021-77bb-4101-a4de-9dbf40fb147d service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:10.890701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-90270d83-3977-4d2f-b799-87173ca48ec6 req-0037f021-77bb-4101-a4de-9dbf40fb147d service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:10.902690 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-90270d83-3977-4d2f-b799-87173ca48ec6 req-0037f021-77bb-4101-a4de-9dbf40fb147d service nova] Creating event network-changed:9c6d7ec3-4424-4f87-91d4-940819f13c02 for instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 on hv-cinder-79733 Jun 17 07:50:10.908066 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-90270d83-3977-4d2f-b799-87173ca48ec6 req-0037f021-77bb-4101-a4de-9dbf40fb147d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030687 Jun 17 07:50:10.908819 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 603/1224] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:50:11.817782 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f5c4b2e8-4b56-4177-a5bf-26e0e95a5570 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:11.818710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f5c4b2e8-4b56-4177-a5bf-26e0e95a5570 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:11.826097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f5c4b2e8-4b56-4177-a5bf-26e0e95a5570 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:11.826533 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f5c4b2e8-4b56-4177-a5bf-26e0e95a5570 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:11.827286 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f5c4b2e8-4b56-4177-a5bf-26e0e95a5570 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:11.827710 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f5c4b2e8-4b56-4177-a5bf-26e0e95a5570 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:11.856603 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f5c4b2e8-4b56-4177-a5bf-26e0e95a5570 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042724 Jun 17 07:50:11.857170 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 622/1225] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:50:11 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:50:12.871529 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b6a507f2-1117-43db-b1dd-5878ac317011 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:12.872528 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b6a507f2-1117-43db-b1dd-5878ac317011 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:12.878686 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b6a507f2-1117-43db-b1dd-5878ac317011 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:12.879138 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b6a507f2-1117-43db-b1dd-5878ac317011 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:12.879902 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b6a507f2-1117-43db-b1dd-5878ac317011 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:12.880341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b6a507f2-1117-43db-b1dd-5878ac317011 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:12.908083 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b6a507f2-1117-43db-b1dd-5878ac317011 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043668 Jun 17 07:50:12.908640 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 604/1226] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:50:12 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:50:12.918808 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:12.919381 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:12.925257 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:12.925735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:12.926484 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:12.926914 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:13.006217 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] HTTP exception thrown: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 is not attached to volume 23c4922e-2f4f-4756-b1fa-93ea927f8072 Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Request method failure captured: Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments/23c4922e-2f4f-4756-b1fa-93ea927f8072 HTTP/1.1 Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDFKotzqi6UFzk61nuNVjb6Pz1yfeink2KT7fJoFlNLSYAfYiacBWK-YZmryTYy8jBMRTVK6FNXzzSp00RonXDlt5_BwpRX3e6X8eHNv_4qXuyllpgzkivNxBIaugfGurYY95zRD6iV_xmsACaZjjyKGTxeE8p2OKy0rgM5mk4PedbQ Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 7b7f8de890ca4b1a82898a24488b32dd Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-TestMinimumBasicScenario-187607751 Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:50:13.008590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7b7f8de890ca4b1a82898a24488b32dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b7f8de890ca4b1a82898a24488b32dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7b7f8de890ca4b1a82898a24488b32dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b7f8de890ca4b1a82898a24488b32dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-TestMinimumBasicScenario-187607751 Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 7b7f8de890ca4b1a82898a24488b32dd Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-TestMinimumBasicScenario-187607751 Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-TestMinimumBasicScenario-187607751-project Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: c4a915f6c02d4facb64d5332904f9fe6 Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-TestMinimumBasicScenario-187607751-project Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:50:13.010359 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 is not attached to volume 23c4922e-2f4f-4756-b1fa-93ea927f8072 Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'server_id': '87eef2c2-52d2-40f0-aa8d-6992dbba0198', 'id': '23c4922e-2f4f-4756-b1fa-93ea927f8072'} Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 23c4922e-2f4f-4756-b1fa-93ea927f8072. Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:50:13.011407 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 is not attached to volume 23c4922e-2f4f-4756-b1fa-93ea927f8072 Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 is not attached to volume 23c4922e-2f4f-4756-b1fa-93ea927f8072 Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:50:13.012977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Returning 404 to user: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 is not attached to volume 23c4922e-2f4f-4756-b1fa-93ea927f8072 {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:50:13.014281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4ea70855-df9d-4924-b349-780dd71b93ba tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "DELETE /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments/23c4922e-2f4f-4756-b1fa-93ea927f8072" status: 404 len: 154 microversion: 2.1 time: 0.095732 Jun 17 07:50:13.014281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 623/1227] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:50:12 2022] DELETE /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198/os-volume_attachments/23c4922e-2f4f-4756-b1fa-93ea927f8072 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:50:14.300878 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cabb0a3e-8080-4823-a7af-2af437625b07 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:14.301390 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cabb0a3e-8080-4823-a7af-2af437625b07 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:14.308034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cabb0a3e-8080-4823-a7af-2af437625b07 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:14.308479 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cabb0a3e-8080-4823-a7af-2af437625b07 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:14.309233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cabb0a3e-8080-4823-a7af-2af437625b07 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:14.309698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cabb0a3e-8080-4823-a7af-2af437625b07 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:14.333464 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cabb0a3e-8080-4823-a7af-2af437625b07 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:50:14.767489 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cabb0a3e-8080-4823-a7af-2af437625b07 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "DELETE /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 204 len: 0 microversion: 2.1 time: 0.470081 Jun 17 07:50:14.768086 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 605/1228] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:50:14 2022] DELETE /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:50:14.777357 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-127c94ad-5c92-48c4-948e-ecc48696e8cd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:14.777974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-127c94ad-5c92-48c4-948e-ecc48696e8cd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:14.784476 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-127c94ad-5c92-48c4-948e-ecc48696e8cd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:14.784916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-127c94ad-5c92-48c4-948e-ecc48696e8cd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:14.785693 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-127c94ad-5c92-48c4-948e-ecc48696e8cd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:14.786119 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-127c94ad-5c92-48c4-948e-ecc48696e8cd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:14.921425 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-127c94ad-5c92-48c4-948e-ecc48696e8cd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:50:14.929081 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-127c94ad-5c92-48c4-948e-ecc48696e8cd tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1554 microversion: 2.1 time: 0.156749 Jun 17 07:50:14.933135 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 624/1229] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:50:14 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:50:15.948263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-7d607a55-02a2-4f7c-879e-27d786b84e72 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:15.948869 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-7d607a55-02a2-4f7c-879e-27d786b84e72 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:15.955964 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7d607a55-02a2-4f7c-879e-27d786b84e72 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:15.956417 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7d607a55-02a2-4f7c-879e-27d786b84e72 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:15.957186 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7d607a55-02a2-4f7c-879e-27d786b84e72 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:15.957658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-7d607a55-02a2-4f7c-879e-27d786b84e72 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:16.090739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-7d607a55-02a2-4f7c-879e-27d786b84e72 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:50:16.098358 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-7d607a55-02a2-4f7c-879e-27d786b84e72 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1554 microversion: 2.1 time: 0.155012 Jun 17 07:50:16.098932 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 606/1230] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:50:15 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:50:17.115954 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5a538ddc-589f-40b1-a7ca-3103ad413b1d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:17.116555 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5a538ddc-589f-40b1-a7ca-3103ad413b1d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:17.123598 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a538ddc-589f-40b1-a7ca-3103ad413b1d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:17.124038 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a538ddc-589f-40b1-a7ca-3103ad413b1d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:17.124796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a538ddc-589f-40b1-a7ca-3103ad413b1d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:17.125225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a538ddc-589f-40b1-a7ca-3103ad413b1d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:17.332651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5a538ddc-589f-40b1-a7ca-3103ad413b1d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:50:17.341052 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5a538ddc-589f-40b1-a7ca-3103ad413b1d tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1554 microversion: 2.1 time: 0.228824 Jun 17 07:50:17.341859 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 625/1231] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:50:17 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:50:17.609050 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-2f50ed90-273f-463b-840c-581e692a6dd7 req-b94164a5-ddad-4fef-be6c-4637f6071b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87eef2c2-52d2-40f0-aa8d-6992dbba0198", "name": "network-vif-deleted", "tag": "9c6d7ec3-4424-4f87-91d4-940819f13c02"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:50:17.618617 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-2f50ed90-273f-463b-840c-581e692a6dd7 req-b94164a5-ddad-4fef-be6c-4637f6071b9a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:17.623161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-2f50ed90-273f-463b-840c-581e692a6dd7 req-b94164a5-ddad-4fef-be6c-4637f6071b9a service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:17.631826 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-2f50ed90-273f-463b-840c-581e692a6dd7 req-b94164a5-ddad-4fef-be6c-4637f6071b9a service nova] Creating event network-vif-deleted:9c6d7ec3-4424-4f87-91d4-940819f13c02 for instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 on hv-cinder-79733 Jun 17 07:50:17.637748 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-2f50ed90-273f-463b-840c-581e692a6dd7 req-b94164a5-ddad-4fef-be6c-4637f6071b9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032573 Jun 17 07:50:17.638409 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 607/1232] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:50:18.358551 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:18.359159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:18.365569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:18.366014 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:18.366764 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:18.367196 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:18.400542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:18.400982 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:18.401449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lazy-loading 'fault' on Instance uuid 87eef2c2-52d2-40f0-aa8d-6992dbba0198 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:50:18.444423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a915f6c02d4facb64d5332904f9fe6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f8de890ca4b1a82898a24488b32dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:50:18.452172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c0e2167a-12d9-48ae-89e1-4d5350479687 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 200 len: 1349 microversion: 2.1 time: 0.097598 Jun 17 07:50:18.453248 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 626/1233] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:50:18 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:50:19.471507 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:19.472199 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] [instance: 87eef2c2-52d2-40f0-aa8d-6992dbba0198] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:50:19.478698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:19.479147 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:19.479900 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:50:19.480332 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:50:19.493213 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] HTTP exception thrown: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 could not be found. Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Request method failure captured: Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 HTTP/1.1 Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDFKotzqi6UFzk61nuNVjb6Pz1yfeink2KT7fJoFlNLSYAfYiacBWK-YZmryTYy8jBMRTVK6FNXzzSp00RonXDlt5_BwpRX3e6X8eHNv_4qXuyllpgzkivNxBIaugfGurYY95zRD6iV_xmsACaZjjyKGTxeE8p2OKy0rgM5mk4PedbQ Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 7b7f8de890ca4b1a82898a24488b32dd Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-TestMinimumBasicScenario-187607751 Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:50:19.494828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7b7f8de890ca4b1a82898a24488b32dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b7f8de890ca4b1a82898a24488b32dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7b7f8de890ca4b1a82898a24488b32dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b7f8de890ca4b1a82898a24488b32dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-TestMinimumBasicScenario-187607751 Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 7b7f8de890ca4b1a82898a24488b32dd Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-TestMinimumBasicScenario-187607751 Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-TestMinimumBasicScenario-187607751-project Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: c4a915f6c02d4facb64d5332904f9fe6 Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-TestMinimumBasicScenario-187607751-project Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 could not be found. Jun 17 07:50:19.496477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '87eef2c2-52d2-40f0-aa8d-6992dbba0198'} Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 could not be found. Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:50:19.497476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 could not be found. Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 could not be found. Jun 17 07:50:19.499091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:50:19.500628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Returning 404 to user: Instance 87eef2c2-52d2-40f0-aa8d-6992dbba0198 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:50:19.500628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ccf35591-d5cc-468e-b8c4-60625957c993 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198" status: 404 len: 111 microversion: 2.1 time: 0.029750 Jun 17 07:50:19.500628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 608/1234] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:50:19 2022] GET /compute/v2.1/servers/87eef2c2-52d2-40f0-aa8d-6992dbba0198 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:50:19.505498 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-223b020f-21ad-4126-9617-1094caafea13 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] Calling method '.version_select at 0x7fb06e53af70>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:50:19.584976 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-223b020f-21ad-4126-9617-1094caafea13 tempest-TestMinimumBasicScenario-187607751 tempest-TestMinimumBasicScenario-187607751-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1002023244" status: 202 len: 0 microversion: 2.1 time: 0.083277 Jun 17 07:50:19.585591 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 627/1235] 10.222.0.52 () {58 vars in 1271 bytes} [Fri Jun 17 07:50:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1002023244 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:51:07.865667 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-06aae694-5822-4500-9301-ef4a7aa51092 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:07.866279 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-06aae694-5822-4500-9301-ef4a7aa51092 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:07.868250 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:07.868893 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:07.874335 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06aae694-5822-4500-9301-ef4a7aa51092 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:07.874779 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06aae694-5822-4500-9301-ef4a7aa51092 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:07.875531 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06aae694-5822-4500-9301-ef4a7aa51092 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:07.875993 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06aae694-5822-4500-9301-ef4a7aa51092 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:07.898912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-06aae694-5822-4500-9301-ef4a7aa51092 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3/ips" status: 200 len: 151 microversion: 2.1 time: 0.037395 Jun 17 07:51:07.899479 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 609/1236] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:51:07 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:51:07.908641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=40 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:07.909509 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:07.913625 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b544853d-ec3b-4bb0-9804-dd352638e260"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:51:07.914724 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:07.921117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:07.921585 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:07.922344 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:07.922770 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:08.000567 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Invalid volume: volume b544853d-ec3b-4bb0-9804-dd352638e260 is already attached to instances: 67581984-cc79-4fe8-a92e-520ab5006ffe Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: POST /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3/os-volume_attachments HTTP/1.1 Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 74 Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:51:08.002328 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {"volumeAttachment": {"volumeId": "b544853d-ec3b-4bb0-9804-dd352638e260"}} Jun 17 07:51:08.004101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Invalid volume: volume b544853d-ec3b-4bb0-9804-dd352638e260 is already attached to instances: 67581984-cc79-4fe8-a92e-520ab5006ffe Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'server_id': 'a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3', 'body': {'volumeAttachment': {'volumeId': 'b544853d-ec3b-4bb0-9804-dd352638e260'}}} Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b544853d-ec3b-4bb0-9804-dd352638e260 is already attached to instances: 67581984-cc79-4fe8-a92e-520ab5006ffe Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:51:08.005273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b544853d-ec3b-4bb0-9804-dd352638e260 is already attached to instances: 67581984-cc79-4fe8-a92e-520ab5006ffe Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:08.007510 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:51:08.009375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:51:08.009375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:51:08.009375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:51:08.009375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b544853d-ec3b-4bb0-9804-dd352638e260 is already attached to instances: 67581984-cc79-4fe8-a92e-520ab5006ffe Jun 17 07:51:08.009375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:51:08.009375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 400 to user: Invalid volume: volume b544853d-ec3b-4bb0-9804-dd352638e260 is already attached to instances: 67581984-cc79-4fe8-a92e-520ab5006ffe {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:51:08.009375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d2970509-7ee1-41e1-bac3-46b055d645bf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096610 Jun 17 07:51:08.009375 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 628/1237] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:51:07 2022] POST /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:51:08.013851 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cf2d8992-d909-4a45-84f0-1893c06daa45 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:08.014344 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cf2d8992-d909-4a45-84f0-1893c06daa45 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:08.021023 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cf2d8992-d909-4a45-84f0-1893c06daa45 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:08.028363 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cf2d8992-d909-4a45-84f0-1893c06daa45 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:08.028363 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cf2d8992-d909-4a45-84f0-1893c06daa45 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:08.028363 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cf2d8992-d909-4a45-84f0-1893c06daa45 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:08.047392 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cf2d8992-d909-4a45-84f0-1893c06daa45 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:51:08.406382 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cf2d8992-d909-4a45-84f0-1893c06daa45 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 204 len: 0 microversion: 2.1 time: 0.397567 Jun 17 07:51:08.406969 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 610/1238] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:51:08 2022] DELETE /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:51:08.423149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-585f543f-7214-4626-a487-168ae17c827c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:08.423149 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-585f543f-7214-4626-a487-168ae17c827c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:08.424660 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-585f543f-7214-4626-a487-168ae17c827c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:08.425112 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-585f543f-7214-4626-a487-168ae17c827c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:08.425924 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-585f543f-7214-4626-a487-168ae17c827c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:08.426391 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-585f543f-7214-4626-a487-168ae17c827c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:08.557908 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-585f543f-7214-4626-a487-168ae17c827c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:08.565591 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-585f543f-7214-4626-a487-168ae17c827c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1683 microversion: 2.1 time: 0.154297 Jun 17 07:51:08.566161 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 629/1239] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:08 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:09.584179 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ae92f08f-a86f-46c2-9264-2ecc0fe8f389 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:09.584975 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ae92f08f-a86f-46c2-9264-2ecc0fe8f389 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:09.591528 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ae92f08f-a86f-46c2-9264-2ecc0fe8f389 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:09.591972 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ae92f08f-a86f-46c2-9264-2ecc0fe8f389 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:09.592725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ae92f08f-a86f-46c2-9264-2ecc0fe8f389 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:09.593158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ae92f08f-a86f-46c2-9264-2ecc0fe8f389 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:09.726470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ae92f08f-a86f-46c2-9264-2ecc0fe8f389 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:09.730070 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ae92f08f-a86f-46c2-9264-2ecc0fe8f389 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1683 microversion: 2.1 time: 0.150249 Jun 17 07:51:09.731333 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 611/1240] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:09 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:10.749163 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-17c12dce-fc99-40f3-be2a-45afab7088cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:10.749795 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-17c12dce-fc99-40f3-be2a-45afab7088cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:10.756408 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17c12dce-fc99-40f3-be2a-45afab7088cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:10.756886 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17c12dce-fc99-40f3-be2a-45afab7088cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:10.757678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17c12dce-fc99-40f3-be2a-45afab7088cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:10.758108 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-17c12dce-fc99-40f3-be2a-45afab7088cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:10.847552 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-17c12dce-fc99-40f3-be2a-45afab7088cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:10.856860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-17c12dce-fc99-40f3-be2a-45afab7088cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1615 microversion: 2.1 time: 0.112615 Jun 17 07:51:10.867010 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 630/1241] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:10 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1615 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:11.120623 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-d49e0b86-b61f-4f3d-afc3-816182a8601d req-8d0a13d1-f001-4e96-8d91-47d5a3a89fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3", "name": "network-vif-deleted", "tag": "5def2155-8ddc-40d7-926a-4241a360ce25"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:51:11.129236 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-d49e0b86-b61f-4f3d-afc3-816182a8601d req-8d0a13d1-f001-4e96-8d91-47d5a3a89fe9 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:11.129712 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-d49e0b86-b61f-4f3d-afc3-816182a8601d req-8d0a13d1-f001-4e96-8d91-47d5a3a89fe9 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:11.141357 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-d49e0b86-b61f-4f3d-afc3-816182a8601d req-8d0a13d1-f001-4e96-8d91-47d5a3a89fe9 service nova] Creating event network-vif-deleted:5def2155-8ddc-40d7-926a-4241a360ce25 for instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 on hv-cinder-79733 Jun 17 07:51:11.146788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-d49e0b86-b61f-4f3d-afc3-816182a8601d req-8d0a13d1-f001-4e96-8d91-47d5a3a89fe9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030286 Jun 17 07:51:11.147716 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 612/1242] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:51:11.874414 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:11.874925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:11.881682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:11.882169 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:11.882939 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:11.883378 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:11.914695 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:11.915147 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:11.915592 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lazy-loading 'fault' on Instance uuid a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:51:11.958493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:11.966717 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-0ae1da6f-d71a-4366-8119-ed8999a36ee6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 200 len: 1331 microversion: 2.1 time: 0.096469 Jun 17 07:51:11.967296 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 631/1243] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:11 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:12.984778 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:12.985403 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:12.991440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:12.991879 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:12.992628 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:12.993060 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:13.006141 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 HTTP/1.1 Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:51:13.007710 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:51:13.009576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3'} Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:51:13.010725 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:51:13.012846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:13.014738 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:51:13.014738 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-65992f33-eea9-430f-a9a7-ae5cc92c124a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 404 len: 111 microversion: 2.1 time: 0.029101 Jun 17 07:51:13.014738 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 613/1244] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:12 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:51:13.018516 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3452c26f-1791-4e4e-ada9-e730ae1a9fca tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '.version_select at 0x7fb06a5c1280>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:13.104324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3452c26f-1791-4e4e-ada9-e730ae1a9fca tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-108451265" status: 202 len: 0 microversion: 2.1 time: 0.089510 Jun 17 07:51:13.104906 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 632/1245] 10.222.0.52 () {58 vars in 1217 bytes} [Fri Jun 17 07:51:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-108451265 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:51:13.968697 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e6c6497c-f460-4587-b552-d96b98a29019 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:13.969221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e6c6497c-f460-4587-b552-d96b98a29019 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:13.975177 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6c6497c-f460-4587-b552-d96b98a29019 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:13.975625 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6c6497c-f460-4587-b552-d96b98a29019 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:13.976389 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6c6497c-f460-4587-b552-d96b98a29019 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:13.976823 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e6c6497c-f460-4587-b552-d96b98a29019 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:14.056500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-e6c6497c-f460-4587-b552-d96b98a29019 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lazy-loading 'services' on Instance uuid 67581984-cc79-4fe8-a92e-520ab5006ffe {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:51:14.281619 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e6c6497c-f460-4587-b552-d96b98a29019 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments/b544853d-ec3b-4bb0-9804-dd352638e260" status: 202 len: 0 microversion: 2.1 time: 0.316857 Jun 17 07:51:14.282233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 614/1246] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:51:13 2022] DELETE /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments/b544853d-ec3b-4bb0-9804-dd352638e260 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:51:14.291110 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4894b89d-e454-4e68-9abb-4bc3c473bb97 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:14.292028 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4894b89d-e454-4e68-9abb-4bc3c473bb97 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:14.299433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4894b89d-e454-4e68-9abb-4bc3c473bb97 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:14.299880 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4894b89d-e454-4e68-9abb-4bc3c473bb97 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:14.300639 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4894b89d-e454-4e68-9abb-4bc3c473bb97 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:14.301079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4894b89d-e454-4e68-9abb-4bc3c473bb97 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:14.329948 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4894b89d-e454-4e68-9abb-4bc3c473bb97 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Jun 17 07:51:14.330501 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 633/1247] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:51:14 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:51:15.111026 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:51:15.111270 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 07:51:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:51:15.343089 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1b17798a-4c0d-4580-af79-40b0a1ae89c6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:15.344091 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-1b17798a-4c0d-4580-af79-40b0a1ae89c6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:15.350199 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1b17798a-4c0d-4580-af79-40b0a1ae89c6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:15.360617 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1b17798a-4c0d-4580-af79-40b0a1ae89c6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:15.360617 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1b17798a-4c0d-4580-af79-40b0a1ae89c6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:15.360617 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-1b17798a-4c0d-4580-af79-40b0a1ae89c6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:15.382094 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1b17798a-4c0d-4580-af79-40b0a1ae89c6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Jun 17 07:51:15.384327 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 615/1248] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:51:15 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:51:16.393816 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-95922e3a-6ec0-4150-89b9-d6c0deec9c21 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:16.394713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-95922e3a-6ec0-4150-89b9-d6c0deec9c21 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:16.401140 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-95922e3a-6ec0-4150-89b9-d6c0deec9c21 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:16.401622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-95922e3a-6ec0-4150-89b9-d6c0deec9c21 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:16.402376 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-95922e3a-6ec0-4150-89b9-d6c0deec9c21 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:16.402809 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-95922e3a-6ec0-4150-89b9-d6c0deec9c21 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:16.431195 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-95922e3a-6ec0-4150-89b9-d6c0deec9c21 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041333 Jun 17 07:51:16.431753 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 634/1249] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:51:16 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:51:16.488448 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-feba91b7-e4c9-41d3-9aa9-90373972931b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:16.488962 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-feba91b7-e4c9-41d3-9aa9-90373972931b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:16.495586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-feba91b7-e4c9-41d3-9aa9-90373972931b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:16.496036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-feba91b7-e4c9-41d3-9aa9-90373972931b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:16.496796 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-feba91b7-e4c9-41d3-9aa9-90373972931b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:16.497238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-feba91b7-e4c9-41d3-9aa9-90373972931b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:16.522363 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-feba91b7-e4c9-41d3-9aa9-90373972931b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:51:16.825450 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-feba91b7-e4c9-41d3-9aa9-90373972931b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 204 len: 0 microversion: 2.1 time: 0.340480 Jun 17 07:51:16.826057 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 616/1250] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:51:16 2022] DELETE /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:51:16.834377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-ff7030ea-65f0-4052-969f-945e4378a8e9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:16.834979 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-ff7030ea-65f0-4052-969f-945e4378a8e9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:16.840866 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ff7030ea-65f0-4052-969f-945e4378a8e9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:16.841304 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ff7030ea-65f0-4052-969f-945e4378a8e9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:16.842958 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ff7030ea-65f0-4052-969f-945e4378a8e9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:16.843423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-ff7030ea-65f0-4052-969f-945e4378a8e9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:16.973115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-ff7030ea-65f0-4052-969f-945e4378a8e9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:16.986312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-ff7030ea-65f0-4052-969f-945e4378a8e9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1682 microversion: 2.1 time: 0.155744 Jun 17 07:51:16.988860 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 635/1251] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:16 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:18.005418 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-45ca707a-b9fc-4b85-bd9b-4f8da893ab36 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:18.006029 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-45ca707a-b9fc-4b85-bd9b-4f8da893ab36 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:18.012551 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-45ca707a-b9fc-4b85-bd9b-4f8da893ab36 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:18.012991 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-45ca707a-b9fc-4b85-bd9b-4f8da893ab36 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:18.013768 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-45ca707a-b9fc-4b85-bd9b-4f8da893ab36 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:18.014200 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-45ca707a-b9fc-4b85-bd9b-4f8da893ab36 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:18.145395 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-45ca707a-b9fc-4b85-bd9b-4f8da893ab36 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:18.152722 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-45ca707a-b9fc-4b85-bd9b-4f8da893ab36 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1682 microversion: 2.1 time: 0.151582 Jun 17 07:51:18.153285 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 617/1252] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:17 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:19.172678 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-992b78af-b5f8-4abd-b4b1-a40e05d0a5b3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:19.173274 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-992b78af-b5f8-4abd-b4b1-a40e05d0a5b3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:19.179575 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-992b78af-b5f8-4abd-b4b1-a40e05d0a5b3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:19.180020 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-992b78af-b5f8-4abd-b4b1-a40e05d0a5b3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:19.180783 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-992b78af-b5f8-4abd-b4b1-a40e05d0a5b3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:19.181224 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-992b78af-b5f8-4abd-b4b1-a40e05d0a5b3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:19.406477 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-992b78af-b5f8-4abd-b4b1-a40e05d0a5b3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:19.414562 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-992b78af-b5f8-4abd-b4b1-a40e05d0a5b3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1682 microversion: 2.1 time: 0.247914 Jun 17 07:51:19.415342 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 636/1253] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:19 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1682 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:19.838161 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-318b6ae1-8ac1-4064-9f85-e24ffef4fa21 req-77cbba2d-5216-4828-bfaf-cda1130cb6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67581984-cc79-4fe8-a92e-520ab5006ffe", "name": "network-vif-deleted", "tag": "f5e1799a-1ce1-4d75-acdd-2d1629f8caf8"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:51:19.847381 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-318b6ae1-8ac1-4064-9f85-e24ffef4fa21 req-77cbba2d-5216-4828-bfaf-cda1130cb6ab service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:19.854189 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-318b6ae1-8ac1-4064-9f85-e24ffef4fa21 req-77cbba2d-5216-4828-bfaf-cda1130cb6ab service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:19.860072 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-318b6ae1-8ac1-4064-9f85-e24ffef4fa21 req-77cbba2d-5216-4828-bfaf-cda1130cb6ab service nova] Creating event network-vif-deleted:f5e1799a-1ce1-4d75-acdd-2d1629f8caf8 for instance 67581984-cc79-4fe8-a92e-520ab5006ffe on hv-cinder-79733 Jun 17 07:51:19.865116 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-318b6ae1-8ac1-4064-9f85-e24ffef4fa21 req-77cbba2d-5216-4828-bfaf-cda1130cb6ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030645 Jun 17 07:51:19.865752 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 618/1254] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:51:20.432168 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:20.432868 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:20.440143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:20.440591 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:20.441419 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:20.441843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:20.473761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:20.474210 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:20.474664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lazy-loading 'fault' on Instance uuid 67581984-cc79-4fe8-a92e-520ab5006ffe {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:51:20.519194 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:20.526874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f0bd728f-5e43-418e-abdf-3802fd162fd9 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 200 len: 1331 microversion: 2.1 time: 0.098674 Jun 17 07:51:20.527449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 637/1255] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:20 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:21.545906 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:21.546599 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:21.552780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:21.553227 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:21.554006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:21.554443 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:21.567760 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe HTTP/1.1 Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:51:21.569449 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:51:21.571222 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '67581984-cc79-4fe8-a92e-520ab5006ffe'} Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:51:21.572914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:51:21.574886 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:51:21.576761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:51:21.576761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-34bad3cb-2513-4b49-8d6d-3d301cda22f3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 404 len: 111 microversion: 2.1 time: 0.029642 Jun 17 07:51:21.576761 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 619/1256] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:21 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:51:21.580583 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-346954fa-53d7-4200-a8f8-cfa8b91daf9b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '.version_select at 0x7fb06e55e700>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:21.648733 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-346954fa-53d7-4200-a8f8-cfa8b91daf9b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046012107" status: 202 len: 0 microversion: 2.1 time: 0.072695 Jun 17 07:51:21.649308 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 638/1257] 10.222.0.52 () {58 vars in 1220 bytes} [Fri Jun 17 07:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046012107 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:51:22.653644 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-813c7baf-617f-45b5-9e9b-6fd3f2992635 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: .version_select at 0x7fb069cd6280>, body: {"keypair": {"name": "tempest-keypair-963631690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECDKO3yl+qHENEkKn518KJ+eWtpFjnsl92zAtRxnI0hrNP7Ex+AgX+WmRbJ878mHVFj8jEmU8KTfauDXzgsGE/x4FNAvPtI+4eDU8K1CQ1DZofsueslvIsXLXh7mY7xPA=="}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:51:22.667843 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-813c7baf-617f-45b5-9e9b-6fd3f2992635 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for project 2b6698fe4fa84871a3685aac8856970a. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:51:22.673408 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-813c7baf-617f-45b5-9e9b-6fd3f2992635 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for user 3af78d3ebe2548f280d84fff4d6cb644 and project 2b6698fe4fa84871a3685aac8856970a. Resources: {'key_pairs'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:51:22.789925 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-813c7baf-617f-45b5-9e9b-6fd3f2992635 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140168 Jun 17 07:51:22.790535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 620/1258] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:51:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:51:25.050086 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1807630222", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fe6f3e5-5a50-45b5-b064-863f94f19a5a"}], "security_groups": [{"name": "tempest-securitygroup--1625653233"}], "key_name": "tempest-keypair-963631690", "user_data": "}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:51:25.152651 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] validate_networks() for [('4fe6f3e5-5a50-45b5-b064-863f94f19a5a', None, None, None, None, None)] {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:51:25.579220 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:51:25.579640 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:51:25.580110 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:51:25.580517 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:51:25.580926 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:51:25.589607 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:25.590051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:25.590832 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:25.591271 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:25.607817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for project 2b6698fe4fa84871a3685aac8856970a. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:51:25.611682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for user 3af78d3ebe2548f280d84fff4d6cb644 and project 2b6698fe4fa84871a3685aac8856970a. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:51:25.622186 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:51:25.624984 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:51:25.782227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-921522df-8cc1-43da-b93b-dfa4fc95ad23 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.737321 Jun 17 07:51:25.783454 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 639/1259] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:51:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:51:25.793514 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5754983b-9456-447d-a8c4-189de9e7f73a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:25.798730 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5754983b-9456-447d-a8c4-189de9e7f73a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:25.852752 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5754983b-9456-447d-a8c4-189de9e7f73a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:25.860272 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5754983b-9456-447d-a8c4-189de9e7f73a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1241 microversion: 2.1 time: 0.070644 Jun 17 07:51:25.860926 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 621/1260] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:25 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:26.878413 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cb3c2854-7560-4f71-b609-5a36efee197c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:26.879016 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cb3c2854-7560-4f71-b609-5a36efee197c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:26.886196 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cb3c2854-7560-4f71-b609-5a36efee197c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:26.886652 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cb3c2854-7560-4f71-b609-5a36efee197c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:26.887422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cb3c2854-7560-4f71-b609-5a36efee197c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:26.888452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cb3c2854-7560-4f71-b609-5a36efee197c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:26.949449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cb3c2854-7560-4f71-b609-5a36efee197c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:26.957574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cb3c2854-7560-4f71-b609-5a36efee197c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1245 microversion: 2.1 time: 0.083662 Jun 17 07:51:26.958138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 640/1261] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:26 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:51:27.975462 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-2cec4e7d-0807-4eab-8249-6a70e0661740 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:27.976036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-2cec4e7d-0807-4eab-8249-6a70e0661740 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:27.982994 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2cec4e7d-0807-4eab-8249-6a70e0661740 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:27.983535 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2cec4e7d-0807-4eab-8249-6a70e0661740 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:27.984488 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2cec4e7d-0807-4eab-8249-6a70e0661740 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:27.984996 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-2cec4e7d-0807-4eab-8249-6a70e0661740 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:28.049518 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-2cec4e7d-0807-4eab-8249-6a70e0661740 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:28.056918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-2cec4e7d-0807-4eab-8249-6a70e0661740 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1311 microversion: 2.1 time: 0.085721 Jun 17 07:51:28.057500 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 622/1262] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:27 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:29.075758 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-83d021d8-9534-451a-82cc-58aed08a2afb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:29.076422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-83d021d8-9534-451a-82cc-58aed08a2afb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:29.082857 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-83d021d8-9534-451a-82cc-58aed08a2afb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:29.083297 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-83d021d8-9534-451a-82cc-58aed08a2afb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:29.084056 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-83d021d8-9534-451a-82cc-58aed08a2afb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:29.084485 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-83d021d8-9534-451a-82cc-58aed08a2afb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:29.283636 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-83d021d8-9534-451a-82cc-58aed08a2afb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:29.291662 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-83d021d8-9534-451a-82cc-58aed08a2afb tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1367 microversion: 2.1 time: 0.220494 Jun 17 07:51:29.292495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 641/1263] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:29 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:29.583552 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-f4911839-41cf-4f29-8e7a-aa060b1f884f req-eeecbe50-5f13-4b49-ae2d-7a03ec7f2126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416de6fe-4513-436f-8df9-3bd31a6ad960", "tag": "b18563f4-53ed-417e-a722-935ff5c9d771"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:51:29.602245 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-f4911839-41cf-4f29-8e7a-aa060b1f884f req-eeecbe50-5f13-4b49-ae2d-7a03ec7f2126 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:29.611145 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-f4911839-41cf-4f29-8e7a-aa060b1f884f req-eeecbe50-5f13-4b49-ae2d-7a03ec7f2126 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:29.623107 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-f4911839-41cf-4f29-8e7a-aa060b1f884f req-eeecbe50-5f13-4b49-ae2d-7a03ec7f2126 service nova] Creating event network-changed:b18563f4-53ed-417e-a722-935ff5c9d771 for instance 416de6fe-4513-436f-8df9-3bd31a6ad960 on hv-cinder-79733 Jun 17 07:51:29.628437 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-f4911839-41cf-4f29-8e7a-aa060b1f884f req-eeecbe50-5f13-4b49-ae2d-7a03ec7f2126 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048773 Jun 17 07:51:29.629034 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 623/1264] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:51:30.310525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9ca2026e-5463-4057-bec0-625224dac0a8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:30.311243 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9ca2026e-5463-4057-bec0-625224dac0a8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:30.317958 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ca2026e-5463-4057-bec0-625224dac0a8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:30.318433 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ca2026e-5463-4057-bec0-625224dac0a8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:30.319223 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ca2026e-5463-4057-bec0-625224dac0a8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:30.319658 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9ca2026e-5463-4057-bec0-625224dac0a8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:30.452940 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9ca2026e-5463-4057-bec0-625224dac0a8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:30.460443 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9ca2026e-5463-4057-bec0-625224dac0a8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1367 microversion: 2.1 time: 0.154432 Jun 17 07:51:30.461002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 642/1265] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:30 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:31.477835 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-482db1c4-3939-488c-838c-6f9ebdc87e2f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:31.478536 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-482db1c4-3939-488c-838c-6f9ebdc87e2f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:31.485461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-482db1c4-3939-488c-838c-6f9ebdc87e2f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:31.485912 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-482db1c4-3939-488c-838c-6f9ebdc87e2f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:31.486661 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-482db1c4-3939-488c-838c-6f9ebdc87e2f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:31.487097 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-482db1c4-3939-488c-838c-6f9ebdc87e2f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:31.618173 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-482db1c4-3939-488c-838c-6f9ebdc87e2f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:31.625928 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-482db1c4-3939-488c-838c-6f9ebdc87e2f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1367 microversion: 2.1 time: 0.152305 Jun 17 07:51:31.626503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 624/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:31 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:32.642636 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-cd940ba7-643b-4151-b65a-7f98e4e275f5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:32.643251 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-cd940ba7-643b-4151-b65a-7f98e4e275f5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:32.649751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cd940ba7-643b-4151-b65a-7f98e4e275f5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:32.650197 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cd940ba7-643b-4151-b65a-7f98e4e275f5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:32.650954 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cd940ba7-643b-4151-b65a-7f98e4e275f5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:32.651390 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-cd940ba7-643b-4151-b65a-7f98e4e275f5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:32.783925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-cd940ba7-643b-4151-b65a-7f98e4e275f5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:32.791432 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-cd940ba7-643b-4151-b65a-7f98e4e275f5 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1367 microversion: 2.1 time: 0.152656 Jun 17 07:51:32.791996 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 643/1267] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:32 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:33.808223 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-85aa20b6-9d69-4bc9-8b54-57cef3861aad tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:33.808842 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-85aa20b6-9d69-4bc9-8b54-57cef3861aad tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:33.815584 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85aa20b6-9d69-4bc9-8b54-57cef3861aad tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:33.816038 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85aa20b6-9d69-4bc9-8b54-57cef3861aad tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:33.816807 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85aa20b6-9d69-4bc9-8b54-57cef3861aad tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:33.817245 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-85aa20b6-9d69-4bc9-8b54-57cef3861aad tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:33.947063 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-85aa20b6-9d69-4bc9-8b54-57cef3861aad tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:33.955244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-85aa20b6-9d69-4bc9-8b54-57cef3861aad tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1367 microversion: 2.1 time: 0.150874 Jun 17 07:51:33.955812 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 625/1268] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:33 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:34.972451 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7c479220-ecc8-4054-92ff-a19c9295040e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:34.973159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7c479220-ecc8-4054-92ff-a19c9295040e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:34.979701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c479220-ecc8-4054-92ff-a19c9295040e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:34.984003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c479220-ecc8-4054-92ff-a19c9295040e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:34.984003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c479220-ecc8-4054-92ff-a19c9295040e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:34.984003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7c479220-ecc8-4054-92ff-a19c9295040e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:35.118066 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7c479220-ecc8-4054-92ff-a19c9295040e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:35.125307 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7c479220-ecc8-4054-92ff-a19c9295040e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1367 microversion: 2.1 time: 0.156755 Jun 17 07:51:35.125894 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 644/1269] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:34 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:36.023936 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=6 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:36.142045 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-419daf8d-a380-45b2-b8ae-2c2eb47b940d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:36.147942 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-419daf8d-a380-45b2-b8ae-2c2eb47b940d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:36.148112 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-b175113d-60e0-40d3-bc5f-b1c588b5929d req-eecf72b8-4539-44ab-a821-873dd3ee3a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416de6fe-4513-436f-8df9-3bd31a6ad960", "name": "network-vif-plugged", "status": "completed", "tag": "b18563f4-53ed-417e-a722-935ff5c9d771"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:51:36.148231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:36.148231 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:36.150580 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-419daf8d-a380-45b2-b8ae-2c2eb47b940d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:36.151028 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-419daf8d-a380-45b2-b8ae-2c2eb47b940d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:36.151651 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-b175113d-60e0-40d3-bc5f-b1c588b5929d req-eecf72b8-4539-44ab-a821-873dd3ee3a15 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:36.151786 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-419daf8d-a380-45b2-b8ae-2c2eb47b940d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:36.152090 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-b175113d-60e0-40d3-bc5f-b1c588b5929d req-eecf72b8-4539-44ab-a821-873dd3ee3a15 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:36.152228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-419daf8d-a380-45b2-b8ae-2c2eb47b940d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:36.164525 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-b175113d-60e0-40d3-bc5f-b1c588b5929d req-eecf72b8-4539-44ab-a821-873dd3ee3a15 service nova] Creating event network-vif-plugged:b18563f4-53ed-417e-a722-935ff5c9d771 for instance 416de6fe-4513-436f-8df9-3bd31a6ad960 on hv-cinder-79733 Jun 17 07:51:36.170322 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-b175113d-60e0-40d3-bc5f-b1c588b5929d req-eecf72b8-4539-44ab-a821-873dd3ee3a15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151759 Jun 17 07:51:36.172953 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 626/1270] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:51:36.289341 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-419daf8d-a380-45b2-b8ae-2c2eb47b940d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:36.296971 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-419daf8d-a380-45b2-b8ae-2c2eb47b940d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1367 microversion: 2.1 time: 0.159436 Jun 17 07:51:36.297593 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 645/1271] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:36 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:51:37.315398 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-ca1745d4-cfeb-4333-9ecd-7c3125aa2da1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:37.316006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-ca1745d4-cfeb-4333-9ecd-7c3125aa2da1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:37.322818 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca1745d4-cfeb-4333-9ecd-7c3125aa2da1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:37.323266 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca1745d4-cfeb-4333-9ecd-7c3125aa2da1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:37.324015 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca1745d4-cfeb-4333-9ecd-7c3125aa2da1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:37.324444 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-ca1745d4-cfeb-4333-9ecd-7c3125aa2da1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:37.457564 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-ca1745d4-cfeb-4333-9ecd-7c3125aa2da1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:37.461072 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:37.465393 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-ca1745d4-cfeb-4333-9ecd-7c3125aa2da1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1367 microversion: 2.1 time: 0.154213 Jun 17 07:51:37.466038 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 627/1272] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:37 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:38.483277 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5347caf5-9989-4d9e-88d9-34a5d122cd72 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:38.483888 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5347caf5-9989-4d9e-88d9-34a5d122cd72 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:38.490493 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5347caf5-9989-4d9e-88d9-34a5d122cd72 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:38.490939 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5347caf5-9989-4d9e-88d9-34a5d122cd72 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:38.491713 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5347caf5-9989-4d9e-88d9-34a5d122cd72 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:38.492133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5347caf5-9989-4d9e-88d9-34a5d122cd72 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:38.496208 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=97 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:38.628333 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5347caf5-9989-4d9e-88d9-34a5d122cd72 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:51:38.635815 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5347caf5-9989-4d9e-88d9-34a5d122cd72 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1557 microversion: 2.1 time: 0.156682 Jun 17 07:51:38.636383 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 646/1273] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:51:38 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:51:38.653101 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4f498421-ae60-4639-aa05-af1361920e54 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:51:38.653745 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4f498421-ae60-4639-aa05-af1361920e54 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:51:38.655966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:38.660910 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4f498421-ae60-4639-aa05-af1361920e54 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:38.661374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4f498421-ae60-4639-aa05-af1361920e54 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:38.662129 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4f498421-ae60-4639-aa05-af1361920e54 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:38.662598 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4f498421-ae60-4639-aa05-af1361920e54 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:38.742637 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4f498421-ae60-4639-aa05-af1361920e54 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094203 Jun 17 07:51:38.746692 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 628/1274] 10.222.0.52 () {58 vars in 1274 bytes} [Fri Jun 17 07:51:38 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:51:39.691264 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-d921c023-0c6b-449a-bfb0-b3dd6b0ac40e req-207b6ee7-ef70-4938-9955-18fb8fc2038c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416de6fe-4513-436f-8df9-3bd31a6ad960", "tag": "b18563f4-53ed-417e-a722-935ff5c9d771"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:51:39.695082 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:51:39.701159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-d921c023-0c6b-449a-bfb0-b3dd6b0ac40e req-207b6ee7-ef70-4938-9955-18fb8fc2038c service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:51:39.701620 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-d921c023-0c6b-449a-bfb0-b3dd6b0ac40e req-207b6ee7-ef70-4938-9955-18fb8fc2038c service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:51:39.712569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-d921c023-0c6b-449a-bfb0-b3dd6b0ac40e req-207b6ee7-ef70-4938-9955-18fb8fc2038c service nova] Creating event network-changed:b18563f4-53ed-417e-a722-935ff5c9d771 for instance 416de6fe-4513-436f-8df9-3bd31a6ad960 on hv-cinder-79733 Jun 17 07:51:39.718578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-d921c023-0c6b-449a-bfb0-b3dd6b0ac40e req-207b6ee7-ef70-4938-9955-18fb8fc2038c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030888 Jun 17 07:51:39.719424 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 647/1275] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:52:54.888902 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e0941aaf-2a2f-4945-b9d1-78d00790fc5a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:52:54.889695 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e0941aaf-2a2f-4945-b9d1-78d00790fc5a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:52:54.895703 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e0941aaf-2a2f-4945-b9d1-78d00790fc5a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:52:54.896289 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e0941aaf-2a2f-4945-b9d1-78d00790fc5a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:52:54.897036 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e0941aaf-2a2f-4945-b9d1-78d00790fc5a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:52:54.897510 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e0941aaf-2a2f-4945-b9d1-78d00790fc5a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:52:54.925481 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e0941aaf-2a2f-4945-b9d1-78d00790fc5a tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/ips" status: 200 len: 150 microversion: 2.1 time: 0.098643 Jun 17 07:52:54.926044 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 629/1276] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:52:54 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/ips => generated 150 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:52:57.662787 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=7 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:52:57.668080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bc393f51-6219-45b3-80f1-10e21155f882 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b62c7c54-c05e-4d4d-94ca-23a30e00b4cc"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:52:57.673339 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-bc393f51-6219-45b3-80f1-10e21155f882 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:52:57.680281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bc393f51-6219-45b3-80f1-10e21155f882 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:52:57.680281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bc393f51-6219-45b3-80f1-10e21155f882 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:52:57.680281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bc393f51-6219-45b3-80f1-10e21155f882 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:52:57.680281 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bc393f51-6219-45b3-80f1-10e21155f882 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:52:58.474638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-bc393f51-6219-45b3-80f1-10e21155f882 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.813610 Jun 17 07:52:58.477470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 648/1277] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:52:57 2022] POST /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:53:06.005605 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b62c7c54-c05e-4d4d-94ca-23a30e00b4cc"}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:53:06.010849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:06.010849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=8 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:06.013808 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:06.014251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:06.015009 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:06.015440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:06.094579 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Invalid volume: volume b62c7c54-c05e-4d4d-94ca-23a30e00b4cc is already attached to instances: 416de6fe-4513-436f-8df9-3bd31a6ad960 Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: POST /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments HTTP/1.1 Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 74 Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:53:06.096472 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {"volumeAttachment": {"volumeId": "b62c7c54-c05e-4d4d-94ca-23a30e00b4cc"}} Jun 17 07:53:06.098376 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Invalid volume: volume b62c7c54-c05e-4d4d-94ca-23a30e00b4cc is already attached to instances: 416de6fe-4513-436f-8df9-3bd31a6ad960 Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'server_id': '416de6fe-4513-436f-8df9-3bd31a6ad960', 'body': {'volumeAttachment': {'volumeId': 'b62c7c54-c05e-4d4d-94ca-23a30e00b4cc'}}} Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b62c7c54-c05e-4d4d-94ca-23a30e00b4cc is already attached to instances: 416de6fe-4513-436f-8df9-3bd31a6ad960 Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:53:06.099476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b62c7c54-c05e-4d4d-94ca-23a30e00b4cc is already attached to instances: 416de6fe-4513-436f-8df9-3bd31a6ad960 Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:53:06.101105 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:53:06.104959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:53:06.104959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:53:06.104959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:53:06.104959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b62c7c54-c05e-4d4d-94ca-23a30e00b4cc is already attached to instances: 416de6fe-4513-436f-8df9-3bd31a6ad960 Jun 17 07:53:06.104959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:53:06.104959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 400 to user: Invalid volume: volume b62c7c54-c05e-4d4d-94ca-23a30e00b4cc is already attached to instances: 416de6fe-4513-436f-8df9-3bd31a6ad960 {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:53:06.104959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-014ca21d-4f82-4ce1-83a6-d89117ff2b58 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096987 Jun 17 07:53:06.104959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 630/1278] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:53:05 2022] POST /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:53:06.161861 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c03c871e-3e19-4e18-9fc0-5879669d33cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:06.162446 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c03c871e-3e19-4e18-9fc0-5879669d33cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:06.169911 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c03c871e-3e19-4e18-9fc0-5879669d33cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:06.170358 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c03c871e-3e19-4e18-9fc0-5879669d33cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:06.171125 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c03c871e-3e19-4e18-9fc0-5879669d33cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:06.171588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c03c871e-3e19-4e18-9fc0-5879669d33cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:06.252981 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.objects.instance [None req-c03c871e-3e19-4e18-9fc0-5879669d33cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lazy-loading 'services' on Instance uuid 416de6fe-4513-436f-8df9-3bd31a6ad960 {{(pid=124472) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:53:06.575849 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c03c871e-3e19-4e18-9fc0-5879669d33cc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments/b62c7c54-c05e-4d4d-94ca-23a30e00b4cc" status: 202 len: 0 microversion: 2.1 time: 0.418254 Jun 17 07:53:06.576449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 649/1279] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:53:06 2022] DELETE /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments/b62c7c54-c05e-4d4d-94ca-23a30e00b4cc => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:53:06.585151 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4764be2d-fc89-4b2f-b166-6cbe92e304df tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:06.586168 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4764be2d-fc89-4b2f-b166-6cbe92e304df tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:06.592849 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4764be2d-fc89-4b2f-b166-6cbe92e304df tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:06.593308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4764be2d-fc89-4b2f-b166-6cbe92e304df tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:06.594084 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4764be2d-fc89-4b2f-b166-6cbe92e304df tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:06.594511 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4764be2d-fc89-4b2f-b166-6cbe92e304df tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:06.624700 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4764be2d-fc89-4b2f-b166-6cbe92e304df tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Jun 17 07:53:06.630604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 631/1280] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:53:06 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:53:07.641489 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b95c188d-40b7-49de-b990-fbb073f95490 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:07.642523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b95c188d-40b7-49de-b990-fbb073f95490 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:07.648848 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b95c188d-40b7-49de-b990-fbb073f95490 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:07.649846 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b95c188d-40b7-49de-b990-fbb073f95490 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:07.650590 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b95c188d-40b7-49de-b990-fbb073f95490 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:07.651019 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b95c188d-40b7-49de-b990-fbb073f95490 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:07.680765 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b95c188d-40b7-49de-b990-fbb073f95490 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Jun 17 07:53:07.681385 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 650/1281] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:53:07 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:53:08.692489 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-37d10988-37d5-4c40-8cca-f9bf0cfa0cc3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:08.693436 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-37d10988-37d5-4c40-8cca-f9bf0cfa0cc3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:08.701006 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-37d10988-37d5-4c40-8cca-f9bf0cfa0cc3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:08.701501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-37d10988-37d5-4c40-8cca-f9bf0cfa0cc3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:08.702260 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-37d10988-37d5-4c40-8cca-f9bf0cfa0cc3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:08.702697 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-37d10988-37d5-4c40-8cca-f9bf0cfa0cc3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:08.730997 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-37d10988-37d5-4c40-8cca-f9bf0cfa0cc3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042726 Jun 17 07:53:08.731477 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 632/1282] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:53:08 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:53:08.789078 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a347b84a-8fcd-4002-9bf8-4eb5dfe0ede7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:08.790171 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a347b84a-8fcd-4002-9bf8-4eb5dfe0ede7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:08.796523 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a347b84a-8fcd-4002-9bf8-4eb5dfe0ede7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:08.796960 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a347b84a-8fcd-4002-9bf8-4eb5dfe0ede7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:08.797735 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a347b84a-8fcd-4002-9bf8-4eb5dfe0ede7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:08.798161 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a347b84a-8fcd-4002-9bf8-4eb5dfe0ede7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:08.826462 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a347b84a-8fcd-4002-9bf8-4eb5dfe0ede7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Going to try to terminate instance {{(pid=124472) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:53:09.172414 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a347b84a-8fcd-4002-9bf8-4eb5dfe0ede7 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 204 len: 0 microversion: 2.1 time: 0.386785 Jun 17 07:53:09.173002 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 651/1283] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:53:08 2022] DELETE /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:53:09.181632 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0f6d3862-b458-4a6f-b07c-0184c7a1a28b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:09.182249 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0f6d3862-b458-4a6f-b07c-0184c7a1a28b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:09.188133 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f6d3862-b458-4a6f-b07c-0184c7a1a28b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:09.188578 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f6d3862-b458-4a6f-b07c-0184c7a1a28b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:09.189351 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f6d3862-b458-4a6f-b07c-0184c7a1a28b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:09.189773 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0f6d3862-b458-4a6f-b07c-0184c7a1a28b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:09.322943 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0f6d3862-b458-4a6f-b07c-0184c7a1a28b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:09.330541 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0f6d3862-b458-4a6f-b07c-0184c7a1a28b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1682 microversion: 2.1 time: 0.153234 Jun 17 07:53:09.331112 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 633/1284] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:09 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:10.349331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-8e9ce6f7-9042-469b-8ee1-2d6a7ad90e47 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:10.350050 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-8e9ce6f7-9042-469b-8ee1-2d6a7ad90e47 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:10.356933 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8e9ce6f7-9042-469b-8ee1-2d6a7ad90e47 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:10.357415 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8e9ce6f7-9042-469b-8ee1-2d6a7ad90e47 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:10.358176 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8e9ce6f7-9042-469b-8ee1-2d6a7ad90e47 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:10.358611 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-8e9ce6f7-9042-469b-8ee1-2d6a7ad90e47 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:10.488083 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-8e9ce6f7-9042-469b-8ee1-2d6a7ad90e47 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:10.496287 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-8e9ce6f7-9042-469b-8ee1-2d6a7ad90e47 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1682 microversion: 2.1 time: 0.151159 Jun 17 07:53:10.496856 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 652/1285] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:10 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:11.514684 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e71f4d78-39c3-4109-9f8d-b4a62ba26bf6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:11.515299 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e71f4d78-39c3-4109-9f8d-b4a62ba26bf6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:11.521739 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e71f4d78-39c3-4109-9f8d-b4a62ba26bf6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:11.523149 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e71f4d78-39c3-4109-9f8d-b4a62ba26bf6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:11.523149 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e71f4d78-39c3-4109-9f8d-b4a62ba26bf6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:11.523385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e71f4d78-39c3-4109-9f8d-b4a62ba26bf6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:11.655719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e71f4d78-39c3-4109-9f8d-b4a62ba26bf6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:11.663179 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e71f4d78-39c3-4109-9f8d-b4a62ba26bf6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1682 microversion: 2.1 time: 0.152415 Jun 17 07:53:11.663747 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 634/1286] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:11 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:53:12.359539 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-e0d95064-1b50-4539-bde0-48aa2d166418 req-03042f13-140d-4978-9182-0410e68b5a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416de6fe-4513-436f-8df9-3bd31a6ad960", "name": "network-vif-deleted", "tag": "b18563f4-53ed-417e-a722-935ff5c9d771"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:53:12.368670 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-e0d95064-1b50-4539-bde0-48aa2d166418 req-03042f13-140d-4978-9182-0410e68b5a80 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:12.369120 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-e0d95064-1b50-4539-bde0-48aa2d166418 req-03042f13-140d-4978-9182-0410e68b5a80 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:12.382530 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-e0d95064-1b50-4539-bde0-48aa2d166418 req-03042f13-140d-4978-9182-0410e68b5a80 service nova] Creating event network-vif-deleted:b18563f4-53ed-417e-a722-935ff5c9d771 for instance 416de6fe-4513-436f-8df9-3bd31a6ad960 on hv-cinder-79733 Jun 17 07:53:12.389346 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-e0d95064-1b50-4539-bde0-48aa2d166418 req-03042f13-140d-4978-9182-0410e68b5a80 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096686 Jun 17 07:53:12.393617 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 653/1287] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:53:12.686810 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:12.687600 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:12.701412 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:12.701841 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:12.702620 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:12.703056 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:12.739235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:12.739840 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:12.740301 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lazy-loading 'fault' on Instance uuid 416de6fe-4513-436f-8df9-3bd31a6ad960 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:53:12.786208 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:12.794596 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d95bb0f3-8e6d-43de-8b50-a3df168907d8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 200 len: 1331 microversion: 2.1 time: 0.117294 Jun 17 07:53:12.795176 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 635/1288] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:12 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:13.812805 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:13.813525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:13.820653 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:13.821445 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:13.822230 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:13.822666 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:13.835666 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 HTTP/1.1 Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:53:13.838225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:53:13.839977 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '416de6fe-4513-436f-8df9-3bd31a6ad960'} Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:53:13.841057 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:53:13.842821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:53:13.844390 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:53:13.844390 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3abbe29c-9876-4197-9b02-47c153ceed70 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 404 len: 111 microversion: 2.1 time: 0.030977 Jun 17 07:53:13.844390 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 654/1289] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:13 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:53:13.848501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-1e0c34f8-28df-49e6-9b2e-003670fdc52f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '.version_select at 0x7fb069c97670>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:13.919248 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-1e0c34f8-28df-49e6-9b2e-003670fdc52f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-963631690" status: 202 len: 0 microversion: 2.1 time: 0.074457 Jun 17 07:53:13.919839 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 636/1290] 10.222.0.52 () {58 vars in 1217 bytes} [Fri Jun 17 07:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-963631690 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:53:14.669075 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-578a7d5a-db17-4a9e-9355-abeceea90dd1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: .version_select at 0x7fb06e59c160>, body: {"keypair": {"name": "tempest-keypair-2133171631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnW611yA26u8mwcHE7/rTRvd0FYwuDI5IjZyfwh39O9tWWp2edZ4Cvpb+92LIN9nZKTznEsWNjPlxL70pJoU0rGyM59hbDd1RicUy7NotXMh4jtquBieknR/NX2vGHcaQ=="}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:53:14.683435 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-578a7d5a-db17-4a9e-9355-abeceea90dd1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for project 2b6698fe4fa84871a3685aac8856970a. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:53:14.687265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-578a7d5a-db17-4a9e-9355-abeceea90dd1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for user 3af78d3ebe2548f280d84fff4d6cb644 and project 2b6698fe4fa84871a3685aac8856970a. Resources: {'key_pairs'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:53:14.784511 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-578a7d5a-db17-4a9e-9355-abeceea90dd1 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119643 Jun 17 07:53:14.785138 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 655/1291] 10.222.0.52 () {60 vars in 1158 bytes} [Fri Jun 17 07:53:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:53:17.179461 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1040104968", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fe6f3e5-5a50-45b5-b064-863f94f19a5a"}], "security_groups": [{"name": "tempest-securitygroup--1553322322"}], "key_name": "tempest-keypair-2133171631", "user_data": "}} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:53:17.282374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.network.neutron [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] validate_networks() for [('4fe6f3e5-5a50-45b5-b064-863f94f19a5a', None, None, None, None, None)] {{(pid=124471) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:53:17.697385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Flavor limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:53:17.697783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Image limits 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:53:17.698252 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Flavor pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:53:17.698655 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Image pref 0:0:0 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:53:17.699062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.virt.hardware [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124471) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:53:17.707568 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:17.708005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:17.708787 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:17.709215 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:17.725147 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for project 2b6698fe4fa84871a3685aac8856970a. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:53:17.729244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.quota [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Getting quotas for user 3af78d3ebe2548f280d84fff4d6cb644 and project 2b6698fe4fa84871a3685aac8856970a. Resources: {'ram', 'cores', 'instances'} {{(pid=124471) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:53:17.740387 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Going to run 1 instances... {{(pid=124471) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:53:17.743431 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124471) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:53:17.957033 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d80e62b7-43ea-4874-97e3-5c49275e8440 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.782261 Jun 17 07:53:17.957672 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 637/1292] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:53:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:53:17.967727 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-1d0dec84-7de2-43c7-ab2f-d23466401770 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:17.968332 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-1d0dec84-7de2-43c7-ab2f-d23466401770 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:18.026968 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-1d0dec84-7de2-43c7-ab2f-d23466401770 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:18.034386 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-1d0dec84-7de2-43c7-ab2f-d23466401770 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1242 microversion: 2.1 time: 0.070514 Jun 17 07:53:18.034942 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 656/1293] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:17 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:19.052148 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-54a3f596-9928-487c-b704-a1cad068eb8f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:19.052701 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-54a3f596-9928-487c-b704-a1cad068eb8f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:19.060556 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54a3f596-9928-487c-b704-a1cad068eb8f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:19.061016 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54a3f596-9928-487c-b704-a1cad068eb8f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:19.061850 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54a3f596-9928-487c-b704-a1cad068eb8f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:19.062291 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-54a3f596-9928-487c-b704-a1cad068eb8f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:19.126282 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-54a3f596-9928-487c-b704-a1cad068eb8f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:19.134238 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-54a3f596-9928-487c-b704-a1cad068eb8f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1246 microversion: 2.1 time: 0.086203 Jun 17 07:53:19.137385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 638/1294] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:19 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:20.151327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-58eb2a81-ae4a-4388-b59e-5bfbdfdde327 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:20.152080 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-58eb2a81-ae4a-4388-b59e-5bfbdfdde327 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:20.158525 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-58eb2a81-ae4a-4388-b59e-5bfbdfdde327 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:20.158960 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-58eb2a81-ae4a-4388-b59e-5bfbdfdde327 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:20.159722 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-58eb2a81-ae4a-4388-b59e-5bfbdfdde327 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:20.160179 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-58eb2a81-ae4a-4388-b59e-5bfbdfdde327 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:20.222609 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-58eb2a81-ae4a-4388-b59e-5bfbdfdde327 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:20.230929 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-58eb2a81-ae4a-4388-b59e-5bfbdfdde327 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1294 microversion: 2.1 time: 0.083490 Jun 17 07:53:20.231501 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 657/1295] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:20 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:21.256501 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8ad88520-f3f1-4cf3-8749-c2c5554614ff tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:21.257130 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8ad88520-f3f1-4cf3-8749-c2c5554614ff tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:21.264603 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8ad88520-f3f1-4cf3-8749-c2c5554614ff tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:21.268118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8ad88520-f3f1-4cf3-8749-c2c5554614ff tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:21.268118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8ad88520-f3f1-4cf3-8749-c2c5554614ff tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:21.268118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8ad88520-f3f1-4cf3-8749-c2c5554614ff tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:21.408050 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8ad88520-f3f1-4cf3-8749-c2c5554614ff tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:21.416077 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8ad88520-f3f1-4cf3-8749-c2c5554614ff tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.163408 Jun 17 07:53:21.416663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 639/1296] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:21 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:22.300604 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-80773809-b2c3-4338-8eee-e93a57e486c4 req-dc27d5db-ad93-4b62-a9bb-8a37a04f02ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762ba520-9153-463f-89d3-50c307475338", "tag": "d9ac27e2-ae48-40ee-9e5d-891835a1cb49"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:53:22.311133 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-80773809-b2c3-4338-8eee-e93a57e486c4 req-dc27d5db-ad93-4b62-a9bb-8a37a04f02ba service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:22.311692 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-80773809-b2c3-4338-8eee-e93a57e486c4 req-dc27d5db-ad93-4b62-a9bb-8a37a04f02ba service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:22.325126 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-80773809-b2c3-4338-8eee-e93a57e486c4 req-dc27d5db-ad93-4b62-a9bb-8a37a04f02ba service nova] Creating event network-changed:d9ac27e2-ae48-40ee-9e5d-891835a1cb49 for instance 762ba520-9153-463f-89d3-50c307475338 on hv-cinder-79733 Jun 17 07:53:22.333609 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-80773809-b2c3-4338-8eee-e93a57e486c4 req-dc27d5db-ad93-4b62-a9bb-8a37a04f02ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037615 Jun 17 07:53:22.334204 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 658/1297] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:53:22.433046 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8273234c-5048-4b42-af02-6574a3cd2bdf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:22.433691 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8273234c-5048-4b42-af02-6574a3cd2bdf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:22.440670 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8273234c-5048-4b42-af02-6574a3cd2bdf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:22.441457 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8273234c-5048-4b42-af02-6574a3cd2bdf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:22.442232 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8273234c-5048-4b42-af02-6574a3cd2bdf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:22.442663 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8273234c-5048-4b42-af02-6574a3cd2bdf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:22.590200 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-8273234c-5048-4b42-af02-6574a3cd2bdf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:22.599233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8273234c-5048-4b42-af02-6574a3cd2bdf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.169963 Jun 17 07:53:22.599816 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 640/1298] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:22 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:23.617709 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-81a935bc-cf26-4855-bbef-12a5873f3bc8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:23.618687 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-81a935bc-cf26-4855-bbef-12a5873f3bc8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:23.625012 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81a935bc-cf26-4855-bbef-12a5873f3bc8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:23.625490 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81a935bc-cf26-4855-bbef-12a5873f3bc8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:23.626241 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81a935bc-cf26-4855-bbef-12a5873f3bc8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:23.626671 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81a935bc-cf26-4855-bbef-12a5873f3bc8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:23.756453 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-81a935bc-cf26-4855-bbef-12a5873f3bc8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:23.764621 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-81a935bc-cf26-4855-bbef-12a5873f3bc8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.151695 Jun 17 07:53:23.765192 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 659/1299] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:23 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:24.781383 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-423d1d0e-e193-4d49-af35-2841d2d152ec tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:24.781922 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-423d1d0e-e193-4d49-af35-2841d2d152ec tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:24.788378 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-423d1d0e-e193-4d49-af35-2841d2d152ec tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:24.788828 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-423d1d0e-e193-4d49-af35-2841d2d152ec tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:24.790331 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-423d1d0e-e193-4d49-af35-2841d2d152ec tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:24.790580 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-423d1d0e-e193-4d49-af35-2841d2d152ec tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:24.919448 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-423d1d0e-e193-4d49-af35-2841d2d152ec tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:24.926797 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-423d1d0e-e193-4d49-af35-2841d2d152ec tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.149436 Jun 17 07:53:24.927538 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 641/1300] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:24 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:25.944175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5fd11375-7b0d-4fc7-8da9-8c37eaad3a5b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:25.944711 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5fd11375-7b0d-4fc7-8da9-8c37eaad3a5b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:25.951661 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5fd11375-7b0d-4fc7-8da9-8c37eaad3a5b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:25.952115 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5fd11375-7b0d-4fc7-8da9-8c37eaad3a5b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:25.952864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5fd11375-7b0d-4fc7-8da9-8c37eaad3a5b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:25.953288 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5fd11375-7b0d-4fc7-8da9-8c37eaad3a5b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:26.084887 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5fd11375-7b0d-4fc7-8da9-8c37eaad3a5b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:26.093023 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5fd11375-7b0d-4fc7-8da9-8c37eaad3a5b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.153100 Jun 17 07:53:26.093623 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 660/1301] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:25 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:27.110092 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5581b7c2-f727-437b-b1fd-808753bf50e3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:27.114846 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5581b7c2-f727-437b-b1fd-808753bf50e3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:27.117164 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5581b7c2-f727-437b-b1fd-808753bf50e3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:27.118292 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5581b7c2-f727-437b-b1fd-808753bf50e3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:27.119056 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5581b7c2-f727-437b-b1fd-808753bf50e3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:27.119493 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5581b7c2-f727-437b-b1fd-808753bf50e3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:27.248914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5581b7c2-f727-437b-b1fd-808753bf50e3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:27.256353 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5581b7c2-f727-437b-b1fd-808753bf50e3 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.150273 Jun 17 07:53:27.256917 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 642/1302] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:27 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:28.274705 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-c62dc713-dfa6-402a-bd32-2e0faa0eae7d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:28.275479 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-c62dc713-dfa6-402a-bd32-2e0faa0eae7d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:28.277927 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:28.278569 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:28.283289 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c62dc713-dfa6-402a-bd32-2e0faa0eae7d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:28.283731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c62dc713-dfa6-402a-bd32-2e0faa0eae7d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:28.284486 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c62dc713-dfa6-402a-bd32-2e0faa0eae7d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:28.284916 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-c62dc713-dfa6-402a-bd32-2e0faa0eae7d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:28.288789 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:28.419574 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-c62dc713-dfa6-402a-bd32-2e0faa0eae7d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:28.426781 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-c62dc713-dfa6-402a-bd32-2e0faa0eae7d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.156584 Jun 17 07:53:28.427380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 661/1303] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:28 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:28.721675 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-1f70e015-44c4-4164-9a2b-63d144bc7d71 req-bbb583d2-6bab-450e-89d9-e31d30563373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762ba520-9153-463f-89d3-50c307475338", "name": "network-vif-plugged", "status": "completed", "tag": "d9ac27e2-ae48-40ee-9e5d-891835a1cb49"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:53:28.725291 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:28.725987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=6 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:53:28.732291 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-1f70e015-44c4-4164-9a2b-63d144bc7d71 req-bbb583d2-6bab-450e-89d9-e31d30563373 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:28.732744 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-1f70e015-44c4-4164-9a2b-63d144bc7d71 req-bbb583d2-6bab-450e-89d9-e31d30563373 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:28.746786 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-1f70e015-44c4-4164-9a2b-63d144bc7d71 req-bbb583d2-6bab-450e-89d9-e31d30563373 service nova] Creating event network-vif-plugged:d9ac27e2-ae48-40ee-9e5d-891835a1cb49 for instance 762ba520-9153-463f-89d3-50c307475338 on hv-cinder-79733 Jun 17 07:53:28.751772 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-1f70e015-44c4-4164-9a2b-63d144bc7d71 req-bbb583d2-6bab-450e-89d9-e31d30563373 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034135 Jun 17 07:53:28.752374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 643/1304] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:53:29.444952 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d4244a6b-98b2-4da5-93cc-246bd4096d6e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:29.445606 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d4244a6b-98b2-4da5-93cc-246bd4096d6e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:29.453395 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d4244a6b-98b2-4da5-93cc-246bd4096d6e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:29.453839 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d4244a6b-98b2-4da5-93cc-246bd4096d6e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:29.454595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d4244a6b-98b2-4da5-93cc-246bd4096d6e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:29.455033 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d4244a6b-98b2-4da5-93cc-246bd4096d6e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:29.589528 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d4244a6b-98b2-4da5-93cc-246bd4096d6e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:29.597557 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d4244a6b-98b2-4da5-93cc-246bd4096d6e tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.157334 Jun 17 07:53:29.598155 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 662/1305] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:29 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:30.617892 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-17cfcf44-aec2-4ea1-88c6-d21f0c1500f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:30.618594 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-17cfcf44-aec2-4ea1-88c6-d21f0c1500f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:30.625366 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-17cfcf44-aec2-4ea1-88c6-d21f0c1500f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:30.625815 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-17cfcf44-aec2-4ea1-88c6-d21f0c1500f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:30.626570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-17cfcf44-aec2-4ea1-88c6-d21f0c1500f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:30.627005 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-17cfcf44-aec2-4ea1-88c6-d21f0c1500f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:30.763380 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-17cfcf44-aec2-4ea1-88c6-d21f0c1500f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:30.771138 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-17cfcf44-aec2-4ea1-88c6-d21f0c1500f6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1368 microversion: 2.1 time: 0.158632 Jun 17 07:53:30.771698 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 644/1306] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:30 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:31.788721 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-7e8ed5f5-1934-4d4e-9449-02b3347cffc6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:31.789298 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-7e8ed5f5-1934-4d4e-9449-02b3347cffc6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:31.797354 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7e8ed5f5-1934-4d4e-9449-02b3347cffc6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:31.797796 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7e8ed5f5-1934-4d4e-9449-02b3347cffc6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:31.798543 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7e8ed5f5-1934-4d4e-9449-02b3347cffc6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:31.799003 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-7e8ed5f5-1934-4d4e-9449-02b3347cffc6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:31.927821 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-7e8ed5f5-1934-4d4e-9449-02b3347cffc6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:53:31.935172 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-7e8ed5f5-1934-4d4e-9449-02b3347cffc6 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1558 microversion: 2.1 time: 0.150772 Jun 17 07:53:31.935731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 663/1307] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:53:31 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:53:31.951747 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d5ed8035-5bc0-403b-8e7b-ddd5a275672f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:53:31.952280 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d5ed8035-5bc0-403b-8e7b-ddd5a275672f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:53:31.958699 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d5ed8035-5bc0-403b-8e7b-ddd5a275672f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:31.959144 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d5ed8035-5bc0-403b-8e7b-ddd5a275672f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:31.959897 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d5ed8035-5bc0-403b-8e7b-ddd5a275672f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:31.960334 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d5ed8035-5bc0-403b-8e7b-ddd5a275672f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:32.037787 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d5ed8035-5bc0-403b-8e7b-ddd5a275672f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089788 Jun 17 07:53:32.038385 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 645/1308] 10.222.0.52 () {58 vars in 1274 bytes} [Fri Jun 17 07:53:31 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:53:33.341869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-52833c1a-b1d6-41b7-836d-e7a3a3753574 req-ce89eac0-b746-4b1f-858c-ed3e86bce044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762ba520-9153-463f-89d3-50c307475338", "tag": "d9ac27e2-ae48-40ee-9e5d-891835a1cb49"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:53:33.349834 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-52833c1a-b1d6-41b7-836d-e7a3a3753574 req-ce89eac0-b746-4b1f-858c-ed3e86bce044 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:53:33.350268 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-52833c1a-b1d6-41b7-836d-e7a3a3753574 req-ce89eac0-b746-4b1f-858c-ed3e86bce044 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:53:33.361542 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-52833c1a-b1d6-41b7-836d-e7a3a3753574 req-ce89eac0-b746-4b1f-858c-ed3e86bce044 service nova] Creating event network-changed:d9ac27e2-ae48-40ee-9e5d-891835a1cb49 for instance 762ba520-9153-463f-89d3-50c307475338 on hv-cinder-79733 Jun 17 07:53:33.366570 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-52833c1a-b1d6-41b7-836d-e7a3a3753574 req-ce89eac0-b746-4b1f-858c-ed3e86bce044 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085541 Jun 17 07:53:33.367250 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 664/1309] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:54:35.119354 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:54:35.120151 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 07:54:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:54:37.954508 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:54:37.955271 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=82 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:54:37.959561 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-8cb044d4-0674-49ac-9aec-6c4d1ffb6fe8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:37.960057 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-8cb044d4-0674-49ac-9aec-6c4d1ffb6fe8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:37.966185 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8cb044d4-0674-49ac-9aec-6c4d1ffb6fe8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:37.966637 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8cb044d4-0674-49ac-9aec-6c4d1ffb6fe8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:37.967416 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8cb044d4-0674-49ac-9aec-6c4d1ffb6fe8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:37.967857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-8cb044d4-0674-49ac-9aec-6c4d1ffb6fe8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:37.994390 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-8cb044d4-0674-49ac-9aec-6c4d1ffb6fe8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/ips" status: 200 len: 150 microversion: 2.1 time: 0.041954 Jun 17 07:54:37.995001 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 646/1310] 10.222.0.52 () {58 vars in 1247 bytes} [Fri Jun 17 07:54:37 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:54:40.753648 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=7 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:54:40.754681 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=19 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:54:40.760387 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-81d505fd-6bbf-4057-bc21-4b780eccf660 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e13cbb1-12f2-496c-bc0c-686c293f5342"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:54:40.761638 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-81d505fd-6bbf-4057-bc21-4b780eccf660 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:40.769051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81d505fd-6bbf-4057-bc21-4b780eccf660 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:40.769051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81d505fd-6bbf-4057-bc21-4b780eccf660 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:40.769874 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81d505fd-6bbf-4057-bc21-4b780eccf660 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:40.770312 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-81d505fd-6bbf-4057-bc21-4b780eccf660 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:41.966480 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-81d505fd-6bbf-4057-bc21-4b780eccf660 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "POST /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.214687 Jun 17 07:54:41.967540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 665/1311] 10.222.0.52 () {60 vars in 1322 bytes} [Fri Jun 17 07:54:40 2022] POST /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:54:50.763147 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-06a31212-a920-44ef-ab95-ef146f3a7cc0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:50.763757 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-06a31212-a920-44ef-ab95-ef146f3a7cc0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:50.771245 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06a31212-a920-44ef-ab95-ef146f3a7cc0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:50.771686 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06a31212-a920-44ef-ab95-ef146f3a7cc0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:50.772577 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06a31212-a920-44ef-ab95-ef146f3a7cc0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:50.773011 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-06a31212-a920-44ef-ab95-ef146f3a7cc0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:50.925723 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-06a31212-a920-44ef-ab95-ef146f3a7cc0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lazy-loading 'services' on Instance uuid 762ba520-9153-463f-89d3-50c307475338 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:54:51.143999 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-06a31212-a920-44ef-ab95-ef146f3a7cc0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments/1e13cbb1-12f2-496c-bc0c-686c293f5342" status: 202 len: 0 microversion: 2.1 time: 0.385453 Jun 17 07:54:51.144720 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 647/1312] 10.222.0.52 () {58 vars in 1415 bytes} [Fri Jun 17 07:54:50 2022] DELETE /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments/1e13cbb1-12f2-496c-bc0c-686c293f5342 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:54:51.155175 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-3cf3eaef-c1d5-4bb4-a492-9d15df5bddbf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:51.156301 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-3cf3eaef-c1d5-4bb4-a492-9d15df5bddbf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:51.160242 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:54:51.165159 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3cf3eaef-c1d5-4bb4-a492-9d15df5bddbf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:51.165662 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3cf3eaef-c1d5-4bb4-a492-9d15df5bddbf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:51.166471 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3cf3eaef-c1d5-4bb4-a492-9d15df5bddbf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:51.166921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-3cf3eaef-c1d5-4bb4-a492-9d15df5bddbf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:51.229051 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-3cf3eaef-c1d5-4bb4-a492-9d15df5bddbf tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077993 Jun 17 07:54:51.230154 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 666/1313] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:54:51 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:54:52.244445 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a1b9a598-ddb1-45c1-a935-262e211c8ca0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:52.245411 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a1b9a598-ddb1-45c1-a935-262e211c8ca0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:52.251870 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a1b9a598-ddb1-45c1-a935-262e211c8ca0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:52.252323 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a1b9a598-ddb1-45c1-a935-262e211c8ca0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:52.253114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a1b9a598-ddb1-45c1-a935-262e211c8ca0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:52.253586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a1b9a598-ddb1-45c1-a935-262e211c8ca0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:52.284965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a1b9a598-ddb1-45c1-a935-262e211c8ca0 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Jun 17 07:54:52.285591 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 648/1314] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:54:52 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:54:53.296790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4b103d24-ea0f-46a9-9afb-99c7bffceb67 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:53.297736 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4b103d24-ea0f-46a9-9afb-99c7bffceb67 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:53.305789 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4b103d24-ea0f-46a9-9afb-99c7bffceb67 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:53.306235 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4b103d24-ea0f-46a9-9afb-99c7bffceb67 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:53.307010 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4b103d24-ea0f-46a9-9afb-99c7bffceb67 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:53.307440 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4b103d24-ea0f-46a9-9afb-99c7bffceb67 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:53.338467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4b103d24-ea0f-46a9-9afb-99c7bffceb67 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045573 Jun 17 07:54:53.339055 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 667/1315] 10.222.0.52 () {58 vars in 1301 bytes} [Fri Jun 17 07:54:53 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:54:53.401806 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-cc4591d8-a9b5-43ff-8d6f-f1c2e19ff06d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:53.402476 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cc4591d8-a9b5-43ff-8d6f-f1c2e19ff06d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:53.409308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cc4591d8-a9b5-43ff-8d6f-f1c2e19ff06d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:53.409790 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cc4591d8-a9b5-43ff-8d6f-f1c2e19ff06d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:53.410583 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cc4591d8-a9b5-43ff-8d6f-f1c2e19ff06d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:53.411114 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-cc4591d8-a9b5-43ff-8d6f-f1c2e19ff06d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:53.440981 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-cc4591d8-a9b5-43ff-8d6f-f1c2e19ff06d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:54:53.792367 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-cc4591d8-a9b5-43ff-8d6f-f1c2e19ff06d tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 204 len: 0 microversion: 2.1 time: 0.394444 Jun 17 07:54:53.793012 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 649/1316] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:54:53 2022] DELETE /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:54:53.801595 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-a1a60cac-0807-4ca6-8f86-ff789738fba8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:53.803131 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-a1a60cac-0807-4ca6-8f86-ff789738fba8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:53.809931 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a1a60cac-0807-4ca6-8f86-ff789738fba8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:53.810377 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a1a60cac-0807-4ca6-8f86-ff789738fba8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:53.811411 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a1a60cac-0807-4ca6-8f86-ff789738fba8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:53.811843 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-a1a60cac-0807-4ca6-8f86-ff789738fba8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:53.955664 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-a1a60cac-0807-4ca6-8f86-ff789738fba8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:54:53.963314 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-a1a60cac-0807-4ca6-8f86-ff789738fba8 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1683 microversion: 2.1 time: 0.165568 Jun 17 07:54:53.963900 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 668/1317] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:54:53 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:54:54.980920 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-d861b07b-1adc-4e02-967d-221191ab7112 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:54.981731 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-d861b07b-1adc-4e02-967d-221191ab7112 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:54.988521 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d861b07b-1adc-4e02-967d-221191ab7112 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:54.988965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d861b07b-1adc-4e02-967d-221191ab7112 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:54.990306 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d861b07b-1adc-4e02-967d-221191ab7112 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:54.990763 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-d861b07b-1adc-4e02-967d-221191ab7112 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:55.134775 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-d861b07b-1adc-4e02-967d-221191ab7112 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:54:55.143002 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-d861b07b-1adc-4e02-967d-221191ab7112 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1683 microversion: 2.1 time: 0.166385 Jun 17 07:54:55.143604 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 650/1318] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:54:54 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:54:56.163322 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9f49d2b9-8555-4170-b91e-36709a33606c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:56.164521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9f49d2b9-8555-4170-b91e-36709a33606c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:56.172826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9f49d2b9-8555-4170-b91e-36709a33606c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:56.173526 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9f49d2b9-8555-4170-b91e-36709a33606c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:56.174519 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9f49d2b9-8555-4170-b91e-36709a33606c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:56.175262 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9f49d2b9-8555-4170-b91e-36709a33606c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:56.522070 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9f49d2b9-8555-4170-b91e-36709a33606c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:54:56.536817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9f49d2b9-8555-4170-b91e-36709a33606c tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1683 microversion: 2.1 time: 0.373839 Jun 17 07:54:56.536817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 669/1319] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:54:56 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1683 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:54:57.392498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-51ac4462-c317-478b-ad09-27cf474bab16 req-7cac8faf-0e19-45df-b64a-1457cdb22ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762ba520-9153-463f-89d3-50c307475338", "name": "network-vif-deleted", "tag": "d9ac27e2-ae48-40ee-9e5d-891835a1cb49"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:54:57.406857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-51ac4462-c317-478b-ad09-27cf474bab16 req-7cac8faf-0e19-45df-b64a-1457cdb22ba1 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:57.407308 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-51ac4462-c317-478b-ad09-27cf474bab16 req-7cac8faf-0e19-45df-b64a-1457cdb22ba1 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:57.419727 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-51ac4462-c317-478b-ad09-27cf474bab16 req-7cac8faf-0e19-45df-b64a-1457cdb22ba1 service nova] Creating event network-vif-deleted:d9ac27e2-ae48-40ee-9e5d-891835a1cb49 for instance 762ba520-9153-463f-89d3-50c307475338 on hv-cinder-79733 Jun 17 07:54:57.425220 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-51ac4462-c317-478b-ad09-27cf474bab16 req-7cac8faf-0e19-45df-b64a-1457cdb22ba1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036328 Jun 17 07:54:57.426185 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 651/1320] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:54:57.558160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-86c275d1-27b7-4814-b4ad-4ee4b6ed680b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:57.558864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-86c275d1-27b7-4814-b4ad-4ee4b6ed680b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:57.568094 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-86c275d1-27b7-4814-b4ad-4ee4b6ed680b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:57.568858 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-86c275d1-27b7-4814-b4ad-4ee4b6ed680b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:57.570420 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-86c275d1-27b7-4814-b4ad-4ee4b6ed680b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:57.571423 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-86c275d1-27b7-4814-b4ad-4ee4b6ed680b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:57.666788 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-86c275d1-27b7-4814-b4ad-4ee4b6ed680b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:54:57.684614 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-86c275d1-27b7-4814-b4ad-4ee4b6ed680b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1615 microversion: 2.1 time: 0.136547 Jun 17 07:54:57.685521 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 670/1321] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:54:57 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1615 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:54:58.705857 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:58.707288 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:58.715909 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:58.716498 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:58.717150 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:58.717662 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:58.769586 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:58.770363 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:58.771850 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.objects.instance [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lazy-loading 'fault' on Instance uuid 762ba520-9153-463f-89d3-50c307475338 {{(pid=124471) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:54:58.829516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af78d3ebe2548f280d84fff4d6cb644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6698fe4fa84871a3685aac8856970a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:54:58.839089 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-42587a7f-89a4-4eaf-811f-ce711fea0060 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 200 len: 1332 microversion: 2.1 time: 0.138275 Jun 17 07:54:58.839696 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 652/1322] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:54:58 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:54:59.865413 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:54:59.866582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:54:59.877960 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:59.878726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:59.880094 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:54:59.880869 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:54:59.905882 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 HTTP/1.1 Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:54:59.909246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:54:59.911183 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '762ba520-9153-463f-89d3-50c307475338'} Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:54:59.913495 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:54:59.915227 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:54:59.916731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:54:59.916731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-08d13fad-2390-4850-a118-7855f638e0ef tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 404 len: 111 microversion: 2.1 time: 0.054167 Jun 17 07:54:59.916731 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 671/1323] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:54:59 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:54:59.923330 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-937337a9-b133-4e7f-a811-9d6e6f9717fc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '.version_select at 0x7fb069c07a60>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:00.010753 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-937337a9-b133-4e7f-a811-9d6e6f9717fc tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133171631" status: 202 len: 0 microversion: 2.1 time: 0.091135 Jun 17 07:55:00.011364 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 653/1324] 10.222.0.52 () {58 vars in 1220 bytes} [Fri Jun 17 07:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133171631 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:55:02.340629 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:02.341240 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:02.352011 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:02.352908 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:02.354374 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:02.355190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:02.375701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 HTTP/1.1 Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:55:02.377258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.380775 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '762ba520-9153-463f-89d3-50c307475338'} Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:55:02.382622 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.385864 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.388848 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:55:02.388848 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-bb319a5e-7d89-4b63-b6e8-5dfc9093f510 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 404 len: 111 microversion: 2.1 time: 0.042120 Jun 17 07:55:02.388848 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 672/1325] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:55:02 2022] DELETE /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:55:02.390470 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:02.391216 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 762ba520-9153-463f-89d3-50c307475338] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:02.398749 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:02.399069 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:02.399836 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:02.400228 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:02.416440 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 HTTP/1.1 Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:55:02.418206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.421254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '762ba520-9153-463f-89d3-50c307475338'} Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:55:02.423244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. Jun 17 07:55:02.425977 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:02.429686 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 762ba520-9153-463f-89d3-50c307475338 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:55:02.429686 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-46f94a20-36d1-4bd8-b9fa-957e55760780 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338" status: 404 len: 111 microversion: 2.1 time: 0.034096 Jun 17 07:55:02.429686 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 654/1326] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:55:02 2022] GET /compute/v2.1/servers/762ba520-9153-463f-89d3-50c307475338 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:55:03.784780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:03.785508 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:03.792532 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:03.792986 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:03.793817 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:03.794947 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:03.811726 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 HTTP/1.1 Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:55:03.813564 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.816673 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '416de6fe-4513-436f-8df9-3bd31a6ad960'} Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:55:03.819190 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.822226 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.825449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:55:03.825449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-bd913e72-0c5d-46f7-a90a-6faf5cdac2db tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 404 len: 111 microversion: 2.1 time: 0.034665 Jun 17 07:55:03.825449 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 673/1327] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:55:03 2022] DELETE /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:55:03.826986 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:03.828030 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 416de6fe-4513-436f-8df9-3bd31a6ad960] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:03.835987 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:03.836434 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:03.837221 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:03.837691 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:03.853539 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 HTTP/1.1 Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:55:03.855545 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.858235 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '416de6fe-4513-436f-8df9-3bd31a6ad960'} Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:55:03.859904 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. Jun 17 07:55:03.862328 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.865233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 416de6fe-4513-436f-8df9-3bd31a6ad960 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:55:03.865233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9eb25b51-bd11-47c6-931d-6ad1c73172ee tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960" status: 404 len: 111 microversion: 2.1 time: 0.035388 Jun 17 07:55:03.865233 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 655/1328] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:55:03 2022] GET /compute/v2.1/servers/416de6fe-4513-436f-8df9-3bd31a6ad960 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:55:03.870169 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:03.870792 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:03.878005 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:03.878575 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:03.879540 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:03.880104 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:03.896831 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 HTTP/1.1 Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:55:03.898452 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.901004 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3'} Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:55:03.902472 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.904772 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.906970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:55:03.906970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-6a815530-87e2-4e34-82ab-b62925a3125b tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 404 len: 111 microversion: 2.1 time: 0.034722 Jun 17 07:55:03.906970 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 674/1329] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:55:03 2022] DELETE /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:55:03.909149 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:03.909884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:03.917966 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:03.918469 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:03.919291 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:03.919791 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:03.934964 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 HTTP/1.1 Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:55:03.936669 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.939384 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': 'a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3'} Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:55:03.940905 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. Jun 17 07:55:03.943068 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:03.945570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:55:03.945570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-9b049a42-4b84-4590-951b-b5e0b5735944 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3" status: 404 len: 111 microversion: 2.1 time: 0.033407 Jun 17 07:55:03.945570 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 656/1330] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:55:03 2022] GET /compute/v2.1/servers/a1af27b8-bdeb-4e5b-83c4-0b1e08f61ca3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:55:05.278425 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:05.279141 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:05.287422 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:05.287974 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:05.288839 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:05.289287 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:05.305882 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: DELETE /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe HTTP/1.1 Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:55:05.307470 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.310117 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': '67581984-cc79-4fe8-a92e-520ab5006ffe'} Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:55:05.311825 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.314464 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.316777 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:55:05.316777 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-f76e9f22-177d-4f15-bc35-1f7722d91166 tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "DELETE /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 404 len: 111 microversion: 2.1 time: 0.034760 Jun 17 07:55:05.316777 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 675/1331] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:55:05 2022] DELETE /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:55:05.318410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:05.330062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] [instance: 67581984-cc79-4fe8-a92e-520ab5006ffe] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:05.330062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:05.330062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:05.330062 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:05.330655 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:05.344407 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.wsgi [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] HTTP exception thrown: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Request method failure captured: Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: request: GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe HTTP/1.1 Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept: application/json Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Accept-Encoding: identity Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Connection: close Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Length: 0 Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Content-Type: application/json Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Host: 10.222.0.52 Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Openstack-System-Scope: None Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: User-Agent: python-urllib3/1.26.9 Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Auth-Token: gAAAAABirDGJXGVngcuoR5YoWU4hfA01U3w29NkGM6m1DlirZzutDV4qWguCRTUHKC7mXWDWiR2x6hn6zuFT-Hxkf1mb7EWrHmrXqu9K0Fq89eyuo5NZjE608CBdY_kb972aL6JdK4JCrrGcivC7JklMKBvezjZfynU9UPHFjVfk6PRre72DRgM Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Id: None Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Domain-Name: None Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Identity-Status: Confirmed Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Is-Admin-Project: True Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Id: default Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Domain-Name: Default Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Project-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Role: reader,member Jun 17 07:55:05.346198 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Roles: reader,member Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b6698fe4fa84871a3685aac8856970a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Id: 2b6698fe4fa84871a3685aac8856970a Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2104448423 Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Id: default Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Domain-Name: Default Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Id: 3af78d3ebe2548f280d84fff4d6cb644 Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: X-User-Name: tempest-AttachVolumeNegativeTest-2104448423-project Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: method: > Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: exception: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.349788 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: action_args: {'id': '67581984-cc79-4fe8-a92e-520ab5006ffe'} Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:55:05.351341 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. Jun 17 07:55:05.353965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: ERROR nova.api.openstack.wsgi Jun 17 07:55:05.356781 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] Returning 404 to user: Instance 67581984-cc79-4fe8-a92e-520ab5006ffe could not be found. {{(pid=124471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:55:05.356781 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-df4c3355-2f3c-4a97-b6ea-9c14e40f106f tempest-AttachVolumeNegativeTest-2104448423 tempest-AttachVolumeNegativeTest-2104448423-project] 10.222.0.52 "GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe" status: 404 len: 111 microversion: 2.1 time: 0.033278 Jun 17 07:55:05.356781 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 657/1332] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:55:05 2022] GET /compute/v2.1/servers/67581984-cc79-4fe8-a92e-520ab5006ffe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:55:56.759848 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1509591592", "imageRef": "1d17dcf4-508a-4bc1-a0d2-b20cedb05103", "flavorRef": "452"}} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:55:56.766097 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_api:SELECT=20 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:56.766756 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:56.829810 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.network.neutron [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] validate_networks() for None {{(pid=124472) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:55:57.147436 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Flavor limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:55:57.147870 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Image limits 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:55:57.148336 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Flavor pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:55:57.148743 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Image pref 0:0:0 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:55:57.149152 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.virt.hardware [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124472) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:55:57.159585 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:57.160035 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:57.160842 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:57.161278 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:57.179667 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Getting quotas for project 19ea4843b80b4a529d904ddd98b95ba2. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:55:57.184427 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.quota [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Getting quotas for user b69c8285100b41338d6a85c4bc7ffdef and project 19ea4843b80b4a529d904ddd98b95ba2. Resources: {'ram', 'cores', 'instances'} {{(pid=124472) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:55:57.196986 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Going to run 1 instances... {{(pid=124472) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:55:57.199327 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d17dcf4-508a-4bc1-a0d2-b20cedb05103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124472) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:55:57.346897 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-4c83e4ec-d27f-4925-bcd5-344aadf9de3d tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591159 Jun 17 07:55:57.347829 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 676/1333] 10.222.0.52 () {60 vars in 1146 bytes} [Fri Jun 17 07:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:55:57.359516 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-42d93017-15b7-4c79-a555-0d806b697587 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:57.360410 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-42d93017-15b7-4c79-a555-0d806b697587 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:57.364251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:57.365101 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:55:57.443374 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-42d93017-15b7-4c79-a555-0d806b697587 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:55:57.452388 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-42d93017-15b7-4c79-a555-0d806b697587 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1215 microversion: 2.1 time: 0.097542 Jun 17 07:55:57.452989 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 658/1334] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:55:57 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:55:58.473691 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-5a92597d-228d-425b-ab01-6d2a64d74b60 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:58.474414 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-5a92597d-228d-425b-ab01-6d2a64d74b60 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:58.481111 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a92597d-228d-425b-ab01-6d2a64d74b60 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:58.481585 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a92597d-228d-425b-ab01-6d2a64d74b60 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:58.482365 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a92597d-228d-425b-ab01-6d2a64d74b60 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:58.482820 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-5a92597d-228d-425b-ab01-6d2a64d74b60 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:58.558930 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-5a92597d-228d-425b-ab01-6d2a64d74b60 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:55:58.569228 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-5a92597d-228d-425b-ab01-6d2a64d74b60 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1219 microversion: 2.1 time: 0.102070 Jun 17 07:55:58.570099 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 677/1335] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:55:58 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:55:59.590175 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-e8407242-fe97-4743-a564-421ace3592d9 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:55:59.590826 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-e8407242-fe97-4743-a564-421ace3592d9 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:55:59.599702 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8407242-fe97-4743-a564-421ace3592d9 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:59.600814 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8407242-fe97-4743-a564-421ace3592d9 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:59.601719 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8407242-fe97-4743-a564-421ace3592d9 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:55:59.602172 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-e8407242-fe97-4743-a564-421ace3592d9 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:55:59.674811 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-e8407242-fe97-4743-a564-421ace3592d9 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:55:59.686350 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-e8407242-fe97-4743-a564-421ace3592d9 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1267 microversion: 2.1 time: 0.100443 Jun 17 07:55:59.686797 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 659/1336] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:55:59 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:56:00.710233 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b0116172-a73f-4533-a5fe-12c92c475a72 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:00.711039 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b0116172-a73f-4533-a5fe-12c92c475a72 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:00.718132 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b0116172-a73f-4533-a5fe-12c92c475a72 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:00.718582 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b0116172-a73f-4533-a5fe-12c92c475a72 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:00.719370 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b0116172-a73f-4533-a5fe-12c92c475a72 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:00.719806 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b0116172-a73f-4533-a5fe-12c92c475a72 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:00.796104 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b0116172-a73f-4533-a5fe-12c92c475a72 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:00.805166 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b0116172-a73f-4533-a5fe-12c92c475a72 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1273 microversion: 2.1 time: 0.099002 Jun 17 07:56:00.805761 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 678/1337] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:00 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:56:01.833183 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-a158db5f-92cf-4ea1-a811-581a5ef7a9e1 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:01.834108 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-a158db5f-92cf-4ea1-a811-581a5ef7a9e1 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:01.846219 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a158db5f-92cf-4ea1-a811-581a5ef7a9e1 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:01.846944 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a158db5f-92cf-4ea1-a811-581a5ef7a9e1 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:01.848149 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a158db5f-92cf-4ea1-a811-581a5ef7a9e1 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:01.848756 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-a158db5f-92cf-4ea1-a811-581a5ef7a9e1 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:02.083666 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-a158db5f-92cf-4ea1-a811-581a5ef7a9e1 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:02.095649 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-a158db5f-92cf-4ea1-a811-581a5ef7a9e1 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.267492 Jun 17 07:56:02.096615 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 660/1338] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:01 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:56:02.234577 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-c82913e5-1a99-4268-bcb1-b384c6cd71e5 req-91eef20b-80d5-4da4-8110-3b39ba2e3565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ec90b9-1bb7-4b03-9815-ddca4642c8c7", "tag": "7ae144d2-f5a8-4469-9803-710be4dacb8a"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:56:02.252275 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c82913e5-1a99-4268-bcb1-b384c6cd71e5 req-91eef20b-80d5-4da4-8110-3b39ba2e3565 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:02.253198 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-c82913e5-1a99-4268-bcb1-b384c6cd71e5 req-91eef20b-80d5-4da4-8110-3b39ba2e3565 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:02.271680 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-c82913e5-1a99-4268-bcb1-b384c6cd71e5 req-91eef20b-80d5-4da4-8110-3b39ba2e3565 service nova] Creating event network-changed:7ae144d2-f5a8-4469-9803-710be4dacb8a for instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 on hv-cinder-79733 Jun 17 07:56:02.280050 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-c82913e5-1a99-4268-bcb1-b384c6cd71e5 req-91eef20b-80d5-4da4-8110-3b39ba2e3565 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052962 Jun 17 07:56:02.280050 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 679/1339] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:56:03.113736 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-5d6d0dc3-c819-4c59-b668-814b5d06ddf5 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:03.114361 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-5d6d0dc3-c819-4c59-b668-814b5d06ddf5 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:03.121427 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d6d0dc3-c819-4c59-b668-814b5d06ddf5 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:03.121884 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d6d0dc3-c819-4c59-b668-814b5d06ddf5 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:03.122670 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d6d0dc3-c819-4c59-b668-814b5d06ddf5 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:03.123106 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-5d6d0dc3-c819-4c59-b668-814b5d06ddf5 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:03.290969 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-5d6d0dc3-c819-4c59-b668-814b5d06ddf5 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:03.299206 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-5d6d0dc3-c819-4c59-b668-814b5d06ddf5 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.189570 Jun 17 07:56:03.299800 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 661/1340] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:03 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:56:04.317116 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-9650a3a5-62d7-43a7-a83f-d5834eafa31f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:04.317915 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-9650a3a5-62d7-43a7-a83f-d5834eafa31f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:04.325588 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9650a3a5-62d7-43a7-a83f-d5834eafa31f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:04.326075 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9650a3a5-62d7-43a7-a83f-d5834eafa31f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:04.326925 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9650a3a5-62d7-43a7-a83f-d5834eafa31f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:04.327394 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-9650a3a5-62d7-43a7-a83f-d5834eafa31f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:04.475751 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-9650a3a5-62d7-43a7-a83f-d5834eafa31f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:04.483701 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-9650a3a5-62d7-43a7-a83f-d5834eafa31f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.171014 Jun 17 07:56:04.484302 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 680/1341] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:04 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:56:05.512263 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-4ac80205-d511-4da2-bc77-c40dd5901bed tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:05.512995 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-4ac80205-d511-4da2-bc77-c40dd5901bed tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:05.519784 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4ac80205-d511-4da2-bc77-c40dd5901bed tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:05.520286 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4ac80205-d511-4da2-bc77-c40dd5901bed tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:05.521099 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4ac80205-d511-4da2-bc77-c40dd5901bed tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:05.521613 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-4ac80205-d511-4da2-bc77-c40dd5901bed tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:05.713024 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-4ac80205-d511-4da2-bc77-c40dd5901bed tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:05.721503 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-4ac80205-d511-4da2-bc77-c40dd5901bed tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.213118 Jun 17 07:56:05.722160 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 662/1342] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:05 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:56:06.740101 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-67e3b6e0-e9fb-439f-8520-ea3095d3ed3f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:06.740790 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-67e3b6e0-e9fb-439f-8520-ea3095d3ed3f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:06.748550 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-67e3b6e0-e9fb-439f-8520-ea3095d3ed3f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:06.749095 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-67e3b6e0-e9fb-439f-8520-ea3095d3ed3f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:06.750056 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-67e3b6e0-e9fb-439f-8520-ea3095d3ed3f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:06.750600 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-67e3b6e0-e9fb-439f-8520-ea3095d3ed3f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:06.938650 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-67e3b6e0-e9fb-439f-8520-ea3095d3ed3f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:06.947110 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-67e3b6e0-e9fb-439f-8520-ea3095d3ed3f tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.211633 Jun 17 07:56:06.948347 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 681/1343] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:06 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:56:07.968244 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-0c638cb4-6814-4046-a48b-f5b6e1e8fc91 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:07.969080 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-0c638cb4-6814-4046-a48b-f5b6e1e8fc91 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:07.973728 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG dbcounter [-] [124471] Writing DB stats nova_cell0:SELECT=2 {{(pid=124471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:56:07.982448 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0c638cb4-6814-4046-a48b-f5b6e1e8fc91 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:07.986837 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0c638cb4-6814-4046-a48b-f5b6e1e8fc91 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:07.986837 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0c638cb4-6814-4046-a48b-f5b6e1e8fc91 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:07.986837 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-0c638cb4-6814-4046-a48b-f5b6e1e8fc91 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:08.160456 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-0c638cb4-6814-4046-a48b-f5b6e1e8fc91 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:08.169287 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-0c638cb4-6814-4046-a48b-f5b6e1e8fc91 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.208294 Jun 17 07:56:08.169998 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 663/1344] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:07 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:56:09.187828 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-b104f109-7849-4a1a-8485-b271fa660e25 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:09.188578 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-b104f109-7849-4a1a-8485-b271fa660e25 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:09.191160 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=2 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:56:09.192066 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG dbcounter [-] [124472] Writing DB stats nova_cell0:SELECT=6 {{(pid=124472) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:56:09.198258 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b104f109-7849-4a1a-8485-b271fa660e25 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:09.198840 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b104f109-7849-4a1a-8485-b271fa660e25 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:09.199483 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b104f109-7849-4a1a-8485-b271fa660e25 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:09.199921 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-b104f109-7849-4a1a-8485-b271fa660e25 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:09.378496 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-b104f109-7849-4a1a-8485-b271fa660e25 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:09.392437 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-b104f109-7849-4a1a-8485-b271fa660e25 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.208301 Jun 17 07:56:09.393559 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 682/1345] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:09 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:56:09.417365 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [req-c74dcbad-ea34-4aed-812e-201c994f89c0 req-6a7cfe94-10ff-42ea-abd3-b559ea1685d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ec90b9-1bb7-4b03-9815-ddca4642c8c7", "name": "network-vif-plugged", "status": "completed", "tag": "7ae144d2-f5a8-4469-9803-710be4dacb8a"}]} {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:56:09.429943 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-c74dcbad-ea34-4aed-812e-201c994f89c0 req-6a7cfe94-10ff-42ea-abd3-b559ea1685d8 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:09.430473 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [req-c74dcbad-ea34-4aed-812e-201c994f89c0 req-6a7cfe94-10ff-42ea-abd3-b559ea1685d8 service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:09.445798 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.compute.server_external_events [req-c74dcbad-ea34-4aed-812e-201c994f89c0 req-6a7cfe94-10ff-42ea-abd3-b559ea1685d8 service nova] Creating event network-vif-plugged:7ae144d2-f5a8-4469-9803-710be4dacb8a for instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 on hv-cinder-79733 Jun 17 07:56:09.452674 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [req-c74dcbad-ea34-4aed-812e-201c994f89c0 req-6a7cfe94-10ff-42ea-abd3-b559ea1685d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039993 Jun 17 07:56:09.453336 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 664/1346] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:56:10.416721 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-190c3345-00c8-44bc-ae6a-0f6e3ee8ce34 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:10.417317 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-190c3345-00c8-44bc-ae6a-0f6e3ee8ce34 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:10.431324 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-190c3345-00c8-44bc-ae6a-0f6e3ee8ce34 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:10.431787 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-190c3345-00c8-44bc-ae6a-0f6e3ee8ce34 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:10.432826 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-190c3345-00c8-44bc-ae6a-0f6e3ee8ce34 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:10.433265 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-190c3345-00c8-44bc-ae6a-0f6e3ee8ce34 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:10.577079 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-190c3345-00c8-44bc-ae6a-0f6e3ee8ce34 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:10.585902 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-190c3345-00c8-44bc-ae6a-0f6e3ee8ce34 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.172958 Jun 17 07:56:10.586491 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 683/1347] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:10 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:56:11.606227 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-b3dc6a0e-6a9d-478d-8e9e-517a39ad5234 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:11.606945 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-b3dc6a0e-6a9d-478d-8e9e-517a39ad5234 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:11.614395 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b3dc6a0e-6a9d-478d-8e9e-517a39ad5234 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:11.614887 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b3dc6a0e-6a9d-478d-8e9e-517a39ad5234 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:11.615798 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b3dc6a0e-6a9d-478d-8e9e-517a39ad5234 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:11.616314 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-b3dc6a0e-6a9d-478d-8e9e-517a39ad5234 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:11.783732 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-b3dc6a0e-6a9d-478d-8e9e-517a39ad5234 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:11.797111 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-b3dc6a0e-6a9d-478d-8e9e-517a39ad5234 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1315 microversion: 2.1 time: 0.195589 Jun 17 07:56:11.798026 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 665/1348] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:11 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:56:12.820064 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-d3ffe098-57b5-41a1-b2dd-6e175d62a5e7 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:12.820685 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-d3ffe098-57b5-41a1-b2dd-6e175d62a5e7 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:12.827237 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d3ffe098-57b5-41a1-b2dd-6e175d62a5e7 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:12.827682 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d3ffe098-57b5-41a1-b2dd-6e175d62a5e7 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:12.828467 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d3ffe098-57b5-41a1-b2dd-6e175d62a5e7 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:12.829576 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-d3ffe098-57b5-41a1-b2dd-6e175d62a5e7 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:13.005707 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-d3ffe098-57b5-41a1-b2dd-6e175d62a5e7 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:13.013455 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-d3ffe098-57b5-41a1-b2dd-6e175d62a5e7 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1465 microversion: 2.1 time: 0.197891 Jun 17 07:56:13.014191 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 684/1349] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:12 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1465 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:56:13.070919 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-bf685d9c-a0b1-4b4b-800b-f4fba95989ff tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:13.071479 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bf685d9c-a0b1-4b4b-800b-f4fba95989ff tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:13.078143 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bf685d9c-a0b1-4b4b-800b-f4fba95989ff tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:13.078587 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bf685d9c-a0b1-4b4b-800b-f4fba95989ff tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:13.080118 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bf685d9c-a0b1-4b4b-800b-f4fba95989ff tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:13.080757 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-bf685d9c-a0b1-4b4b-800b-f4fba95989ff tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:13.108367 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-bf685d9c-a0b1-4b4b-800b-f4fba95989ff tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Going to try to terminate instance {{(pid=124471) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:56:13.406780 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-bf685d9c-a0b1-4b4b-800b-f4fba95989ff tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 204 len: 0 microversion: 2.1 time: 0.339515 Jun 17 07:56:13.407931 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 666/1350] 10.222.0.52 () {58 vars in 1238 bytes} [Fri Jun 17 07:56:13 2022] DELETE /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:56:13.416641 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-21cc1f3b-9d0c-4e27-be7d-4e6cd31d64f4 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:13.417246 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-21cc1f3b-9d0c-4e27-be7d-4e6cd31d64f4 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:13.424184 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-21cc1f3b-9d0c-4e27-be7d-4e6cd31d64f4 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:13.424730 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-21cc1f3b-9d0c-4e27-be7d-4e6cd31d64f4 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:13.426427 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-21cc1f3b-9d0c-4e27-be7d-4e6cd31d64f4 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:13.427045 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-21cc1f3b-9d0c-4e27-be7d-4e6cd31d64f4 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:13.596331 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.policy [None req-21cc1f3b-9d0c-4e27-be7d-4e6cd31d64f4 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124472) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:13.605104 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-21cc1f3b-9d0c-4e27-be7d-4e6cd31d64f4 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1471 microversion: 2.1 time: 0.192428 Jun 17 07:56:13.605813 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 685/1351] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:13 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:56:14.625092 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-41dc2c45-5b30-4a3a-9e67-d7f96c286530 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:14.626576 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-41dc2c45-5b30-4a3a-9e67-d7f96c286530 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:14.634427 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-41dc2c45-5b30-4a3a-9e67-d7f96c286530 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:14.634952 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-41dc2c45-5b30-4a3a-9e67-d7f96c286530 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:14.635783 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-41dc2c45-5b30-4a3a-9e67-d7f96c286530 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:14.636254 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-41dc2c45-5b30-4a3a-9e67-d7f96c286530 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:14.802337 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-41dc2c45-5b30-4a3a-9e67-d7f96c286530 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:14.816927 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-41dc2c45-5b30-4a3a-9e67-d7f96c286530 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1471 microversion: 2.1 time: 0.195964 Jun 17 07:56:14.817914 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 667/1352] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:14 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:56:15.586263 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [req-7a6ed956-a739-44c8-b788-94f909a977fd req-3f18305f-8627-4208-a06a-8c067ddc4b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ec90b9-1bb7-4b03-9815-ddca4642c8c7", "name": "network-vif-deleted", "tag": "7ae144d2-f5a8-4469-9803-710be4dacb8a"}]} {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:56:15.596072 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-7a6ed956-a739-44c8-b788-94f909a977fd req-3f18305f-8627-4208-a06a-8c067ddc4b9b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:15.596512 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [req-7a6ed956-a739-44c8-b788-94f909a977fd req-3f18305f-8627-4208-a06a-8c067ddc4b9b service nova] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:15.609148 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.compute.server_external_events [req-7a6ed956-a739-44c8-b788-94f909a977fd req-3f18305f-8627-4208-a06a-8c067ddc4b9b service nova] Creating event network-vif-deleted:7ae144d2-f5a8-4469-9803-710be4dacb8a for instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 on hv-cinder-79733 Jun 17 07:56:15.615143 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [req-7a6ed956-a739-44c8-b788-94f909a977fd req-3f18305f-8627-4208-a06a-8c067ddc4b9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038864 Jun 17 07:56:15.615780 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 686/1353] 10.222.0.52 () {64 vars in 1317 bytes} [Fri Jun 17 07:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:56:15.847027 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.api.openstack.wsgi [None req-86df0e2c-c326-4150-86b0-c562dfdc6d06 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:15.847690 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.compute.api [None req-86df0e2c-c326-4150-86b0-c562dfdc6d06 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124471) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:15.855264 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-86df0e2c-c326-4150-86b0-c562dfdc6d06 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:15.856158 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-86df0e2c-c326-4150-86b0-c562dfdc6d06 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:15.857959 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-86df0e2c-c326-4150-86b0-c562dfdc6d06 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:15.858597 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG oslo_concurrency.lockutils [None req-86df0e2c-c326-4150-86b0-c562dfdc6d06 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:15.957310 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: DEBUG nova.policy [None req-86df0e2c-c326-4150-86b0-c562dfdc6d06 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69c8285100b41338d6a85c4bc7ffdef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ea4843b80b4a529d904ddd98b95ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124471) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:56:15.966326 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO nova.api.openstack.requestlog [None req-86df0e2c-c326-4150-86b0-c562dfdc6d06 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 200 len: 1300 microversion: 2.1 time: 0.124971 Jun 17 07:56:15.966918 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: [pid: 124471|app: 0|req: 668/1354] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:15 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:56:16.175276 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:56:16.175588 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Fri Jun 17 07:56:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:56:16.988994 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Calling method '>' {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:56:16.989750 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.compute.api [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] [instance: e8ec90b9-1bb7-4b03-9815-ddca4642c8c7] Fetching instance by UUID {{(pid=124472) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:56:16.996225 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:16.996669 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:16.997478 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:56:16.997922 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG oslo_concurrency.lockutils [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Lock "1d9e8a95-f347-4e57-9496-74641ae5645e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124472) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:56:17.011992 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.wsgi [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] HTTP exception thrown: Instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 could not be found. Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Request method failure captured: Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: request: GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 HTTP/1.1 Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept: application/json Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Accept-Encoding: identity Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Connection: close Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Length: 0 Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Content-Type: application/json Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Host: 10.222.0.52 Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Openstack-System-Scope: None Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: User-Agent: python-urllib3/1.26.9 Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Auth-Token: gAAAAABirDOKr0g7PeYF0zeWma-DS5kRjeQ1Xw6Ri3aXxwbsyED2NcMzBEf4GhVxH8trUTqsFrHjPovQiUfjvHOGbsem6votPDMjuFsPRBQNx-xnUBNubsr_pkBAbYEReANuIBzQ3BaQOuJ8W7YWMjWh-z4Wye-NK5qXLDhJCRTUmXVrdLh1hTc Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Id: None Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Domain-Name: None Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Identity-Status: Confirmed Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Is-Admin-Project: True Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Id: default Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Domain-Name: Default Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Id: 19ea4843b80b4a529d904ddd98b95ba2 Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Project-Name: tempest-VolumesNegativeTest-740745833 Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Role: reader,member Jun 17 07:56:17.013674 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Roles: reader,member Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/19ea4843b80b4a529d904ddd98b95ba2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19ea4843b80b4a529d904ddd98b95ba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_19ea4843b80b4a529d904ddd98b95ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/19ea4843b80b4a529d904ddd98b95ba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}] Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant: tempest-VolumesNegativeTest-740745833 Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Id: 19ea4843b80b4a529d904ddd98b95ba2 Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-Tenant-Name: tempest-VolumesNegativeTest-740745833 Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User: tempest-VolumesNegativeTest-740745833-project Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Id: default Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Domain-Name: Default Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Id: b69c8285100b41338d6a85c4bc7ffdef Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: X-User-Name: tempest-VolumesNegativeTest-740745833-project Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: method: > Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: exception: Instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 could not be found. Jun 17 07:56:17.015502 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: action_args: {'id': 'e8ec90b9-1bb7-4b03-9815-ddca4642c8c7'} Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: {{(pid=124472) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 could not be found. Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:56:17.016586 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 could not be found. Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 could not be found. Jun 17 07:56:17.023380 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: ERROR nova.api.openstack.wsgi Jun 17 07:56:17.025566 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: DEBUG nova.api.openstack.wsgi [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] Returning 404 to user: Instance e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 could not be found. {{(pid=124472) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:56:17.025566 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO nova.api.openstack.requestlog [None req-2163332f-ce0e-4d05-8d99-8ce91fa01492 tempest-VolumesNegativeTest-740745833 tempest-VolumesNegativeTest-740745833-project] 10.222.0.52 "GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7" status: 404 len: 111 microversion: 2.1 time: 0.031777 Jun 17 07:56:17.025566 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: [pid: 124472|app: 0|req: 687/1355] 10.222.0.52 () {58 vars in 1235 bytes} [Fri Jun 17 07:56:16 2022] GET /compute/v2.1/servers/e8ec90b9-1bb7-4b03-9815-ddca4642c8c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:56:30.864316 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:56:30.865303 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 07:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:57:59.150296 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:57:59.150965 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Fri Jun 17 07:57:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:59:36.184014 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:59:36.184764 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Fri Jun 17 07:59:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:59:50.874444 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:59:50.875045 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 07:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:01:15.131853 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:01:15.132619 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 08:01:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:01:19.158658 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:01:19.159251 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Fri Jun 17 08:01:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:01:45.428273 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:01:45.428922 dv-cinder-797333-4-iscsi devstack@n-api.service[124472]: Fri Jun 17 08:01:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 08:01:48.412718 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 08:01:48.413380 dv-cinder-797333-4-iscsi devstack@n-api.service[124471]: Fri Jun 17 08:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!